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(54) Title: SYSTLM AND METHOD FOR IMAGE COMPRESSION AND DECOMPRESSION 



(57) Abstract 

A wavelet-based image compression sys- 
tem and method are presented (24). Compression 
is accomplished by performing a wavelet trans- 
formation of an input digital image (20). The 
resulting wavelet coefficients arc compared to a 
threshold value. Coefficients falling below the 
threshold are discarded. The remaining coeffi- 
cients are quantized (26). The quantized coeffi- 
cients are then compressed using an entropy en- 
coding technique (28). 
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WO 98/40842 PCT/US98/O470O 

SYSTEM AND METHOD FOR IMAGE COMPRESSION AND DECOMPRESSION 

This application claims the benefit of U.S. 
Provisional Application No. 60/040,241, filed March 11, 
1997, System and Method for Still Image Compression, 
which is incorporated herein by reference. 

Field of the Invention 



The present invention relates generally to 
digital image compression/decompression, and 
particularly, to a wavelet-based system and method of 
10 image compression and decompression. 

Background of the Invention 

Nearly every computer user needs to store, 
transfer, and view images. These images include still 
images, or pictures, as well as video images, which are 

15 sequences of still images displayed in a manner that 
depicts motion. The enormous size of image files leads 
to serious file management limitations. For example, a 
single still image (equivalent to a video frame) 
displayed by a rectangular array of picture elements 

20 (pixels) arranged in 640 rows and 800 columns, with the 
color of each pixel represented by twenty-four bits, 
would require over 1.5 megabytes of digital memory to 
store. One solution to this problem is high-quality data 
compression technology. Essentially, image compression 

25 mathematically transforms a grid of image pixels into a 
new, much smaller set of digital values holding the 
information needed to regenerate the original image or 
data file. 

In addition imaging systems, compression 
30 technology can be incorporated into "video on demand" 
systems, such as video servers. Compression technology 
can also be applied to streaming video, which is the 
real-time capture and display of video images over a 
communications link. Applications for streaming video 



WO 98/40842 



PCT/US98/04700 



2 

include video telephones, remote security systems, and 
other types of monitoring systems. 

Several standards for compressing real-time 
video currently exist. The H.263 standard for real-time 
5 video is an industry standard based upon the discrete co- 
sign transform (DCT) . DCT is also the basis for both of 
the public domain image compression standards, MPEG 
(Motion Picture Experts Group) and JPEG (Joint 
Photographic Experts Group) . Although the DCT approach 

10 performs interframe coding adequately, its compression 
ratio and speed can be improved upon. 

Various other types of data compression have 
been developed in recent years. Conventional data 
compression techniques are generally referred to as being 

15 either "lossless" or "lossy", depending upon whether data 
is discarded in the compression process. Examples of 
conventional lossless compression techniques include 
Huffman encoding, arithmetic encoding, and Fano-Shannon 
encoding. With a lossless compression, the decompression 

20 process will reproduce all bits of the original image. 
Lossless compression is important for images found in 
such applications as medical and space science. In such 
situations, the designer of the compression algorithm 
must be very careful to avoid discarding any information 

25 that may be required or even useful at some later point. 

Lossy compression, in contrast, provides greater 
efficiency over lossless compression in terms of speed 
and storage, as some data is discarded. As a result, 
lossy techniques are employed where some degree of 

30 inaccuracy relative to the input data is tolerable. 
Accordingly, lossy compression is frequently used in 
video or commercial image processing. Two popular lossy 
image compression standards are the MPEG and JPEG 
compression methods. 

35 The wavelet transform has proven to be one of 

the most powerful tools in the field of data compression. 
Theoretically, the wavelet transformation is lossless, 
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but since all computers have only finite precision even 
when using floating point calculations, most of the 
transformations are lossy in practice. On the other 
hand, integer calculations are much faster than floating 
5 point for virtually all computers; and integer 

computations are much easier to implement in hardware, 
which is more important in some applications. While 
integers require less memory than real numbers, the 
direct use of integers in conventional wavelet transforms 
10 and their inverses typically causes an unacceptable loss 
of accuracy- Accordingly, there is a need for a wavelet- 
based compression technique that permits lossless or 
near-lossless data compression, yet retains the speed and 
r.emory advantages of integer arithmetic. 

15 

Summary of the Invention 

It is an advantage of the present invention to 
provide a system and method of wavelet-based data 
compression that permits integer computations in a 

20 computer without significant loss of accuracy. This is 
accomplished by using an integer reversible wavelet 
transform that possesses a property of precision 
preservation (PPP) . The integer reversible transform 
greatly reduces the computer resources needed to compress 

25 and decompress images, as well as the time required to 
perform the same. 

It is an advantage of the present invention to 
provide a system and method of wavelet-based image 
compression that is suitable for both still and video 

30 images. 

It is also an advantage of the present invention 
to provide a system and method of image compression that 
is capable of selectively performing lossless and lossy 
compression of either color or gray-scale images. 
35 According to one aspect of the invention, a 

wavelet-based image compression method can be implemented 
using a software program. Compression is accomplished by 



WO 98/40842 



PCT/US98/04700 



4 

performing a wavelet transform on an input digital image. 
The resulting wavelet components are compared to a 
threshold value; coefficients falling below the threshold 
are discarded. The remaining coefficients are quantized. 
5 The quantized coefficients are then compressed using an 
entropy encoding technique, such as arithmetic, run 
length, or Huffman encoding, or a combination of Huffman 
and run length encoding. The wavelet transform can be an 
integer reversible wavelet transform derived using a 

10 lifting scheme or correction method, while the 

quantization scheme can be sub-band oriented. To further 
enhance the speed of the compression scheme, input color 
image pixels can be reduced using a color table. In 
addition, color pixels can be transformed between color 

15 spaces prior to wavelet transformation. 

According to another aspect of the invention, a 
corresponding method of decompression is provided. 

According to another aspect of the present 
invention, a compression method is provided that allows 

20 user selected portions of an image to compressed to 

different image qualities, whereby permitting non-uniform 
image compression. 

According to another aspect of the present 
invention, a compression method is provided that permits 

25 compression quality to be based on image specific 
parameters . 

According to another aspect of the present 
invention, a method of compressing images using a "split 
and merge" technique is provided. 

30 According to further aspect of the present 

invention, an image compression system includes a 
compressor configured to generate a compressed image 
based on an integer wavelet transform derived using 
either a lifting scheme or correction method. The 

35 compressor can be implemented using one or more 

electronic components, such as application specific 
integrated circuits (ASICs), microprocessors, discrete 



WO 98/40842 



PCT/US98/04700 



logic components, or any combination of the 
aforementioned. 

According to another aspect of the present 
invention, a corresponding image decompression system is 
5 provided. 

Brief Description of the Drawings 

The invention is pointed out with particularity 
in the appended claims. However, other features of the 
invention will become more apparent, and the invention 
10 will be best understood by referring to the following 

detailed description in conjunction with the accompanying 
drawings, in which: 

FIG. 1 illustrates a flow diagram for a method 
of compressing an image that is in accordance with an 
15 embodiment of the present invention; 

FIGS. 2-4 depict wavelet coefficients for 
various levels of decomposition; 

FIG. 5 illustrates a flow diagram of a method of 
decompressing an image that has been compressed using the 

20 method of FIG. 1; 

FIG. 6 is a block diagram of a system that can 
incorporate a software program implementing any of the 
methods shown in FIGS. 1, 5, and 8-13 in accordance with 
a second embodiment of the present invention; 
25 FIG. 7 is a block diagram of a system for 

compressing and decompressing an image in accordance with 
another embodiment of the present invention; 

FIG. 8 illustrates a flow diagram of a method 
compressing an image that is in accordance with a further 
30 embodiment of the present invention; 

FIG. 9 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 8; 

FIG. 10 illustrates a flow diagram of a method 
35 of compressing an image in accordance with a further 
embodiment of the present invention; 
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FIG. 11 illustrates a flow diagram of a method 
of decompressing an image that has been compressed 
according to the method of FIG. 10; 

FIG. 12 illustrates a flow diagram of a method 
5 of compressing an image that is in accordance with a 
further embodiment of the present invention; and 

FIG. 13 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 12. 

10 Detailed Description of the Preferred Embodiments 

Referring now to the drawings, and in particular 
to FIG. 1, there is shown a flow diagram of a method for 
compressing an image that conforms to a first embodiment 
of the invention. In step 20, a digital image is 

15 received from an image source. The digital image 

consists of a matrix of values representing an array of 
pixels. Specifically, the array of pixels represents a 
still image or a frame from a video image. In step 22, 
the image is optionally displayed on an appropriate 

20 viewing device, such as a computer or video display unit 
having a flat panel or cathode ray tube (CRT) . Next, in 
step 24, color and wavelet transformations of the image 
take place. The image transformations involved in this 
step include color transform for color images only, and 

25 wavelet transform for both gray level images and color 
images. In step 2 6, the values representing the 
transformed images are quantized and compared to 
thresholds. Values falling outside the threshold are 
discarded. In step 28, the remaining quantized values 

30 are encoded to remove redundant information, creating a 
compressed image file. Next, in step 30 the compressed 
image file is generated as output. 

Referring to the color transformation of step 
24, digital color images are typically based on an RGB 

35 color model, such as is commonly used with TIFF or BMP 
images. In order to get a higher compression ratio, the 
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RGB pixels are transformed to other color models, such as 
YIQ or YUV models. The method can convert RGB inputs 
into YIQ or YUV color spaces according to the following 
relationships . 



5 RGB to YIQ: 



fY]=r 0.299 0.587 
| I | =| -0.596 -0.275 
[Qj=L 0.212 -0.523 



o.ii4i r*i 

0.321| |G| 
0.311J L B J 



RBG to YUV: 

IC TY>r 0.299 

|U|=| 0.148 

|_VJ=L 0.615 



0.587 0.114] fR| 
-0.289 0.439| |G| 
-0.515 -0.1J LBJ 



In the YIQ color space, there is one 
luminescence ( Y) and two color planes (I, Q) . The Y 

15 component is critical, while the I-Q components are less 
sensitive to error introduced by data compression. 

The wavelet transform (also referred to as 
wavelet decomposition) operates on the converted color 
space signals. The purpose of the wavelet transform is 

20 to represent the original image by a different basis to 
achieve the objective of decorrelation. There are many 
different wavelet transforms that can be used in this 
step. For instance, the reversible integer wavelet 
transform described herein below is a preferred wavelet 

25 transform. However, to develop a better understanding of 
the preferred transform, the following alternative 
wavelet transform is first described. 

Let C° = [Cj k ] (j - 0, M-1; k = 0, 

N-1) represent the original, uncompressed image, where M 
30 and N are integers which have the common factor 2 L (L is a 
positive integer) . A one-level wavelet decomposition, 
where L = 1, results in the four coefficient quadrants as 
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10 



15 



shown in Figure 2. Each quadrant represents a set of 
wavelet coefficients. 

Quadrant C 1 represents the blurred image of the 
original image C°, where C 1 -ic>*] O' B 0,_, Jc-o,-., . 

HD 1 represents the horizontal high frequency part of C°, 
while VD 1 represents the vertical high frequency part of 
C°, and DD 1 represents the diagonal high frequency part of 
C°. The decomposition can be iteratively repeated L times 
to obtain different levels of decomposition. For 
example, for L = 2, C° is set to equal C 1 . The iterative 
formula for computing a decomposition is given as 
follows : 

(1) Let C° = rC°, r>0 is a factor which can be changed for 
different needs. 

(2) Transform for image columns: 

For k=0,...,N-l, calculate 



a °* 2 1 

71 = 1 /Tr-O 



M 



(3.1.1) 



For k=0,...,N-l, calculate 



^Ok'^l.k 



N-2 lr-r-° - a «~2 If 
'K'^N-l.k — I 



C' 1 
—1 

2 



(3.1.2) 



(3) Transform for rows: 

For j ■ 0, . . . M/2 - 1, computing 
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hd j.o = o / 

* (3.1.3) 



and 



2 



c jk~ c j, 2k*l 2 ' ~" ' *2 ~ ' 



(3.1.4) 



For j = 0, . . . , M/2 - 1, computing 
dd J-° — 2 ' 



(3.1.5) 



and 



(3.1.6) 



(4) C J = [cj,*] , HD 1= [hdj tk ] , VD 1 [\)d} >k ] and DD= [ddJ <Jt ] , jf«0,..., 

Remark: If it is necessary, we also can use matrix 
5 multiply Wavelet Coefficient Image of 1 levels=W 1 C°W 1 T . 
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Here, W 1 is the transform matrix for 2 level wavelet 
decomposition. 

FIG. 3 depicts a three-level wavelet 
decomposition, where L = 3. 
5 In step 26, the first loss in accuracy occurs. 

Both thresholding and quantization reduce accuracy with 
which the wavelet coefficients are represented. In step 
26, the wavelet coefficients are matched against 
threshold values, and if the values are less than the 

10 established threshold values specified, then the 
resultant value is set to zero. 

An important feature of the invention is that 
the wavelet coefficients are then quantized to a number 
of levels depending upon which quadrant is being 

15 processed, and the desired compression or quality factor. 
This can be very important in image compression, as it 
tends to make many coefficients zeros, especially those 
for high spatial frequencies, which reduces the size of a 
compressed image. 

20 A multilevel uniform thresholding method can be 

used as described below. 

Let T = (t„ t L , t L+1 )be the chosen 

thresholds, where t t is the threshold for 1 the (1=1, 
L) level and t l4l is a threshold for blurred image C L . 

25 Thresholding sets every entry in the blocks C L , HD 1 , VD 1 
and DD 1 (1 = 1, . . . L) to be zero if its absolute value is 
not greater than the corresponding threshold. 

For color images, three threshold vectors which 
correspond three different color planes, such as y, I and 

30 Q, are used. 

The step of quantization essentially scales the 
wavelet coefficients and truncates them to a 
predetermined set of integer values. The quantization 
table shown in Table i can be used. 
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q J «D 










q 2 vD 










q*DD 


• • • 







TABLE 1 

5 In Table 1, the entries q\ D are quantization 

factors for blocks HD 1 (1=1, ... L), q 1 ™ and q\ D for 
blocks VD 1 and DD 1 (1 = 1, • .., L) respectively, and the 
factor q c L+1 is for the most blurred image C L . The factors 
can be integers between 0 and 255. The quantization 
10 scheme for the block HD 1 (1=1, L) is 

.-,1 hd jxqib m 1>v _ n N , (3.2.1 

hd} k = round — — , j-0,..., --?-l;k-0 — i. , 



Here, hd^ij-O. -^-1; ,*=0,..., ^-l) are quantized 
wavelet coefficients of block HD 1 (2=1, ...,L) 

max£r,= max (\hdj ik \) . 

Oiji (Af/2 J -l) 
0i/ci(JV/2 J -l) 

and the function round (x) gives the nearest integer of x. 
Equation (3.2.1) is used for quantization of the other 
blocks (quadrants) . 

For color images, there are three separate 

15 quantization tables for the different color bands. 

In step 28, entropy compression is applied to 
the resultant coefficients using either Arithmetic, Run 
Length, or Huffman, or Huffman and Run Length combined. 
The compression algorithm can be selected at run-time by 

20 the user, based on the desired compression ratio and the 
amount of time required to get the selected level of 
compression. The encoding step includes the entropy 
compression as well as coefficient rearranging. 
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An alternative process to that shown in FIG. 1 
includes an optional down sampling of the IQ color 
planes. This down sampling may be done once or twice to 
produce two image planes either one-fourth or one- 
5 sixteenth the size of the original plane. If the down 
sampling is done, it will be accomplished prior to the 
wavelet transform of step 24. The down sampling reduces 
the compression time and size of the image file. 

FIG. 5 shows a corresponding method for 

10 decompressing an image compressed using the method of 
FIG. 1. In step 40, the compressed image file is input. 
In step 42, the image is decoded. Next, in step 44 the 
values are de-quantized. Next, in step 4 6 inverse color 
and wavelet transformations are performed on the de- 

15 quantized data. In step 48, optional image post- 
processing takes place to refine the decompressed image. 
In step 50, the decompressed image is displayed. 

The decoding of step 42 is the inverse operation 
of the encoding of step 28. Similarly, it can be divided 

20 into two parts: Entropy decoding (Huffman or 
arithmetic), and coefficient rearranging. 

The decoding step produces quantized wavelet 
coefficients in 3*L+1 blocks. Dequantizing (step 44) 
uses the same quantization table as quantizing (Table 1) , 

25 and the scheme as follows: for 1=1, . L 

K»° i \" aX " '^ n -'|- 1 ' *=0,_,|-1. (4.2.D 

Equation (4.2.1) produces the approximate coefficients 
for the blocks HD 1 (1=1, L) , which are shown in 

FIG. 3. The dequantizing scheme for other blocks is 
similar to 4.1.2) . 
30 In step 46, the inverse wavelet transform, also 

referred to as wavelet reconstruction, is performed prior 
to the inverse color transformation. FIG. 4 depicts a 
one-level wavelet reconstruction. 
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The wavelet reconstruction can be iteratively 
performed for various levels of decomposition, according 
to the following equations. 
(1) Inverse transform for rows: 

For j=0, , -1/ calculate 



5 i - Bd » . 

c y.i" u<: y.o 2 

& -nri 1 + dd lk~ dd lk*l kml E-2 

d »-i.* m * d i,2£+ dd ),2*- 



(4.3.1) 



and 



For j=0, M/2 - 1, calculate 
c i,i- c j-o + 2 

Cj,2k*l~Cjk+ ,K-X,...,— 

^l =C j,Ii^ +hd l^' 



(4.3.2) 



(4.3.3) 



and 



r C}.o BC k- 2hd J.O' (4-3.4 



(2) Inverse transform for column: 
10 For k=0, N - 1, calculate 

and 
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-o _.i ^ 3}k+3i.k 
Ci,k-C 0 k + = > 



(4.3.5) 



=— 0 _ 0 -31 



(4.3.6) 



Cj.k'CS.k lz> j'Q.~.M-l t k=Q N-l.C°~[cS, k ]*xf 



Following the inverse wavelet transformation, an 
inverse color transform is performed. Equations (5) -(6) 
give the inverse transforms for the YIQ and YUV color 
spaces. 

For YIQ to RGB: 
[R] T 1.000 0.956 
|G|=| 1.000 -0.272 
[_Bj [ 1-000 -1.106 



0. 621"| TyI 
-0.647| | X | 
1 .703J LQJ 



15) 



10 



For YUV to RGB: 
fR] f 1.000 0.000 
|G|=| 1.000 -0.395 
|_Bj L 1-000 2.032 



1.1401 r*i 

-0 - 581 1 |U| 

o.oooj L V J 



(6) 



In step 48, a user can optionally apply image 
filtering to improve the image quality. Filters are 

15 known in the art for sharpening, smoothing and 

brightening images. Users can choose any number of 
processing filters at compression time. Information 
defining the selected filters can be stored in the coded 
image file, in a form such as a one byte flag in a file 

20 header. In addition to optionally applying the filters, 
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the method can also- be implemented to automatically 
detect and apply the selected filters following 
decompression. 

To sharpen an image, a filter is used that 
5 weights the eight pixels adjacent to the current pixel, 
as well as the current pixel, by one or more 
predetermined values. The weighted values of the nine 
pixels are then summed to derive a new value for the 
current pixel. For example, the surrounding eight pixel 

10 values can be weighted by the value -35/800, while the 

current pixel is weighted by 1.35. The sharpening filter 
:s applied to every pixel in the image. 

To smooth images, for every pixel, the average 
of the pixel and the eight adjacent pixels is calculated. 

15 Then the pixel value and the average is compared. The 
smaller of the two replaces the original pixel and is 
output as the smoothed pixel value. 

To brighten images, the weighted sum of each 
pixel and the correspond eight adjacent pixels is 

20 calculated. For example, each of the adjacent pixels can 
be multiplied by the value 1/90 and the summed with the 
current pixel to obtain a brighten current pixel. 

Another filter that can be used is one that adds 
a random value between [-12, 12) to each of the pixels in 

25 the image. 

In FIG. 6 there is displayed a preferred 
hardware platform that can execute software for 
implementing an embodiment of the present invention. The 
computer system of FIG. 3 includes a CPU 62, a main 

30 memory 64, an I/O subsystem 66, and a display 68, all 
coupled to a CPU bus 70. The I/O subsystem 66 
communicates with peripheral devices that include an 
image source 72, an image storage device 74, and a mass 
storage memory 76. Although shown as three separate 

35 devices, peripherals 72-76 can be implemented using a 

single memory device, such as a hard disk drive commonly 
found in computers. 
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The image source 72 may be a digital still image 
or video source, such as a CD-ROM drive, scanner, or 
network connection. In addition, the image source 85 can 
include analog video sources, such as a video camera, 
5 VCR, television broadcast or cable receiver. The analog 
video signals would be converted to a digital form by the 
image source 85 using conventional conversion techniques. 
Alternatively, an image source 72 can include a video 
camera and communications systems for transmitting real- 
10 time video to the I/O subsystem 66. 

The image storage 74 can be a computer disk, 
such as a that used by a hard drive, or a portable memory 
medium, such as a floppy or ZIP disk, or a read/write 
optical CD. 

15 in operation, a computer program, which 

implements aspects of the invention, is retrieved from 
the mass storage memory 76 into the main memory 64 for 
execution by the CPU 62. Upon execution of the 
compression aspect of the invention, the compressed image 

20 file can be stored in the image storage 74; while upon 
execution of the decompression aspect of the invention, 
the decompressed image can be viewed on the display 68. 
Operating under the control of the computer program, the 
CPU 62 can process images according to the methods set 

25 forth herein, as shown in FIGS. 1-2 and 6-10. 

FIG. 7 illustrates an alternative hardware 
platform implementing a system in accordance with a 
further embodiment of the present invention. System 80 
can be implemented using a variety of different hardware 

30 components, such as ASIC (Application Specific Integrated 
Circuits), or a combination of discrete digital 
components, such as microprocessors, standard logic 
components, and other programmable logic devices. The 
system 80 includes a compression system 81 and a 

35 decompression system 82. The compression system 81 can 
be configured to perform any one or combination of the 
compression methods set forth in FIGS. 1, 8, 10, and 12; 
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while the decompression system can be configured to 
perform any one or combination of the decompression 
methods set forth in FIGS. 5, 9, 11, and 13. 

An image source 85 provides digital pixel values 
5 to a color converter 84. The image source 85 can provide 
the same functionality as described earlier for the image 
source 72 of FIG. 6. 

The color converter 84 performs a color space 
transformation on the input pixels, such as any of those 

10 described herein for FIG. 1. The converter functionality 
can be provided by conventional integrated circuits that 
are readily available from various manufacturers. 
Compressor 86 compresses the transformed pixels, removing 
redundant data. The compressed image file generated by 

15 the compressor 86 can be transferred directly to the 
decompression system 82 over a transmission medium 91. 
The transmission medium 91 can be a radio-link, computer 
network, cable television network, or satellite link. 
Alternatively, the compressor 86 can transmit its output 

20 to a portable storage medium 92, such as an optical, 

floppy, or ZIP disk; or to a mass storage device 94 such 
as a computer hard disk or archival system. 

The decompressor 88 expands the compressed image 
file by applying an inverse wavelet transformation, as 

25 well as de-quantization and de-encoding functions. The 
decompressed data is then passed to an inverse color 
converter 90 that applies an inverse color space 
transformation to generate pixel values in a color space 
and format appropriate for the image display 89. 

30 Standard electronic components are readily available for 
performing the function of the inverse color converter 
90. 

FIG. 8 illustrates a flow diagram of a method of 
compressing an image in accordance with an alternative 
35 embodiment of the present invention. In step 100, a 
digital image is input. In step 102, a color space 
transformation is performed on the input image pixels. 
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In step 104, the pixels are subjected to a wavelet 
transformation. In step 106, sub-band quantization is 
performed on the wavelet coefficients. Next, in step 108 
the quantized sub-bands are respectively entropy encoded. 
5 In step 110, the coded image file is output. 

Sub-band oriented quantization and entropy 
coding are well suited for wavelet-based image 
compression. The main idea is to take the advantage of 
different quantizations at different sub-bands (wavelet 

10 quadrant) and encode each band accordingly. Quadrants 
having a high variance in wavelet values can be allocated 
a finer mesh size for quantization, while those quadrants 
with smaller variances will be assigned fewer levels of 
quantization. That is, the number of bits one wishes to 

15 allocate to the output could be varied by quadrant. 

Those quadrants with large variances will utilize more 
bits, while those with low variants will utilize fewer 
bits. In this way, the number of bits resulting from 
quantization will remain the same, but their allocation 

20 will differ depending upon the nature of the image. This 
technique greatly improves image quality while 
maintaining a high compression ratio. 

FIG. 9 illustrates a flow diagram of a method of 
decompressing an image compressed according to the 

25 methods shown in FIG. 8. Step 120, the compressed file 
is input. In step 122, the input image is entropy 
decoded. In step 124, de-quantization is performed on 
the decoded image file. Next, in step 126, an inverse 
wavelet transform is performed on the image.. In step 

30 128, an inverse color transformation is performed. In 
step 130, post-processing altering is optionally 
performed. In step 132, the decompressed image file is 
then displayed. 

FIG. 10 illustrates a flow diagram of a method 

35 of compressing an image in accordance with another 
embodiment of the present invention. This method 
performs color-bit depth compression, which essentially 
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reduces the number of colors in the image to achieve 
compression. In step 140, the image is input with its 
original color. For example, each color pixel could be 
represented by a standard 24-bit value. Next, in step 
5 142, a color table is created corresponding to the image. 
The color table is a set of quantized color values. The 
quantized color values represent a smaller number of 
colors with correspondingly fewer bits. Each of the 
input pixels is mapped to the color table. In step 144, 

10 an index is calculated for each pixel in the image by 

dithering the pixel values. Dithering is accomplished by 
weighting pixels adjacent to the current pixel in a frame 
and then arithmetically combining the weighted values 
with the current pixel value to produce the index, which 

15 then represents the current pixel. The dithering process 
is repeated for each pixel in a frame. In step 146, the 
indexes are wavelet transformed. In step 148, the 
wavelet coefficients are entropy coded. In step 150, the 
coded image file is output. 

20 FIG . 11 illustrates a flow diagram of a method 

of decompressing an image that has been compressed 
according to the method shown in FIG. 10. In step 160, a 
compressed image file is received. Next, in step 162, 
the image file is entropy decoded. In step 164, an 

25 inverse wavelet transform is applied to the decoded data. 
Next, in step 166, post-processing filtering of the image 
is optionally applied. Next, in step 168, the 
decompressed image is displayed. 

FIG. 12 illustrates another method of 

30 compressing an image in accordance with another 

embodiment of the present invention. In this method, a 
user can selective vary compression parameters (step 173) 
to obtain a lossless or near-lossless compressed image at 
a desired compression ratio. In step 170/ the image is 

35 input. In step 172, an integer color transform is 

performed on the input image. In step 173, compression 
parameters are selected by the user using a software 
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interface. These parameters can include those described 
herein below in the subsection title "Peak Signal to 
Noise Ratio (PSNR) Controlled Compression". In step 174, 
an integer wavelet transform is performed on the color 
5 transformed pixels. In step 176, the wavelet 

coefficients are entropy coded. Next, in step 178, the 
compressed image file is then output from the system. 

The integer color transformation of step 172 is 
an integer reversible transform which can be used in 
10 color image compression to reduce processing time and 

image size. Step 172 transforms RGB color components to 
a set of color components Y-Nb-Nr, which are known. 

The RGB to Y-Nb-Nr transform is given by the 
equations : 

15 Y = G + Int(R/2 + B/2), 

Nb = B - Int(Y/2), 
Nr = R - Int(Y/2) . 

The integer wavelet transform of step 174 is 
described below in detail. 
20 FIG. 13 illustrates a method of decompressing an 

image file that has been compressed according to the 
method shown in FIG. 12. In step 180, a compressed image 
file is input. In step 182, the image is entropy 
decoded. Next, in step 184, an inverse integer wavelet 
25 transform is performed on the decoded data. In step 186, 
an inverse integer color transform is performed. Next, 
in step 188 optional post-processing filtering is 
performed on the image. Next, in step 190, the 
decompressed image is displayed. 
30 The Y-Nb-Nr to RGB transform of step 186 is 

given by the equations: 

R = Nr + Int(Y/2), 
B - Nb + Int(Y/2), 
G = Y - Int (R/2 + B/2) 
35 The inverse integer wavelet transform of step 

184 is described in detail below. 
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Reversible Integer Wavelet Transform 
This method allows a series of transformations 
which are very close to the corresponding biorthogonal 
wavelet transforms or some non-orthogonal wavelet 
5 transforms, but can be calculated with only integer 
addition and bit-shift operations. In addition, the 
integer wavelet transforms created disclosed herein 
possess a property of precision preservation (PPP) . This 
property is very useful for conserving memory in both 
10 compression and decompression, and speed up the whole 

procedure in some applications. Two general methods from 
which one can get the integer wavelet transform desired 
are disclosed. 

Basic Integer Wavelet Transformations 
15 Two examples are provided as the starting point 

for the unique method. For the sake of convenience, 
length, and simplicity, presented is only the algorithm 
for a one level decomposition and reconstruction and only 
for a one dimensional signal. The extension to two 
20 dimensions is immediate as the rows and columns can be 
treated into a sequence of one dimensional signals. For 

the following examples, assume that {rf}^ is the 

original signal where the superscript indicates level and 
the subscript indicates a particular point in the signal. 

25 Also, {cn}^' 1 and are its decomposition parts at the 

first level. Here 
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if N is an even number, 
1 if N is an odd number; 



{c*}*" 1 and {da}*] 1 are its low frequency (1) 

part and high frequency (h) part, respectively. For 
multi-levels, we just create {cj}}^ 1 as {c£}* 0 and repeat 

the procedure again. 

Example 1 : A (2, 2) -wavelet transform by integer 
calculation. 

This transformation is similar to a variation of 
the Haar wavelet transform which uses low and 
high pass analysis (decomposition) filters given 
as : 



n 


0 


1 










1/2 


1/2 


9n 


1/2 


-1/2 



(1) Compute 

(2) Compute 



WO 98/40842 



PCT/US98/04700 



23 



\lnt( ^ ) +C21C+1, if N is an even number, 
CjS-i, if # is ai3 odd number, 



Here, Int(x) is an arbitrary rounding function 
which may have different interpretations. For example, 
Int (x) can be the integer which is nearest to x, or 
Int (x) may be any integer which satisfies x-KInt(x)s x, 
etc. It is easy to see that all entries in both 



K},^ are integers. 



From (2.1)- (2.2)/ we can easily get the 
following integer reconstruction algorithm: 
(b) Reconstruction 
10 (l)If N is an even number, compute: 

d 1 



or, if N is an odd number, we have 

2 (2.4) 



(2) Compute 



(2.5) 
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Remark. Since (2.1)- (2.6) are not linear because of the 
rounding operation Int(x), this means the transformation 
order becomes significant. For instance, if the 
decomposition was applied first to the columns and then 
5 to the rows, the inverse transformation must be applied 
first to the rows and then to the columns. 

Example 2 : Lazy wavelet transform. 
The lazy wavelet transform is used to illustrate an 
important concept. The corresponding inverse transform 
L0 is nothing else but sub-sampling the even and odd indexed 
samples. Decomposition and reconstruction can use the 
same formula as follows: 

dk=ci k + 1 ,k>*Q,...,M 1 -l. 

Examples 1 and 2 are not good transforms for 
image compression, but they are simple. Much better 

5 transforms can be achieved from these two. As suggested 
above, they are considered only as a starting point for 
the integer, reversible, wavelet transform algorithm of 
the disclosed invention. 

It is noted that there is another interesting 

0 property in the above two transforms which may not be 
easily seen. If the values of the signal pixels are 
represented by a finite number of bits, say one bit or 
one byte, the same number of bits can be used to 
represent the result of the forward transform within the 

5 computer itself because of the complementary code 

property. While, from the reconstruction algorithm, the 
computer will get back the exact original signal through 
the same complementary code property. This property is 
called a Property of Precision Preservation (PPP) for 

0 these wavelets. 

It is known that the general values for the high 
frequency wavelet coefficients are small, and all higher 
levels of the decomposition also provide generally small 
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values in the high frequency band. This allows the 
preservation of precision during the computational stage 
of the wavelet coefficients. Now, the complementary code 
property, the other aspect of the PPP property is a well 
known characteristic of integer arithmetic as done by the 
computer. Consider the computation of the difference of 
two integers given as c - b - a and the inverse 
computation of a - b - c. The nature of the computation 
within the computer can be specified as follows: 

b-a if -2«- i ii)-a<2«~ 1 -l 
c„= T -2*+b-a if Jb-ai2»" 1 
2*+b-a ifb-a<-2"- 1 



10 and the inverse is 



fa-Cm 

2 <?+£>- c 



if '2"- l sb-a<2^-l 



if b-c m < -V 



where the m subscript indicates the internal 
representation, and the range of the integers a, b, c 

is [-2*"\2«" l -l] . The internal representation of c m when 

it is outside the range, its appearance is as a two's 
15 complement number, so the representation may not be the 
same as the external representation of c. However, the 
same complementary code for the a m will cause the internal 
representation to be identical to the external 
representation of a. For example, if we let b = 2 
20 (00000010) and a = -127 (10000001) then c m has the 

internal binary value of (10000001) when q=4 . With a 
value of -127 for c m the inverse value for a„ will just be 
a. 

In fact, for Example 2, this property is 
25 obviously true. While for Example 1, if the range of the 
pixel values is within a finite number of bits, say q, we 
can only use q bits as the working unit, which means the 
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value of transform coefficients will also be within the 
interval with length 2 q , say [-2^, 2 qM - 1] . Due to the 
nature of computation on a machine, most machines will 
implement (2.1)-(2.2) automatically as follows (the 
complementary code property) : 



c 2 °*-c 2 Vx, if -2^c 2 Vc 2 °*-i<2*- 1 , 
c 2 Vc&*i-2«, if c^-c^^- 1 , 



(2.6) 



d 1 d 1 
Int(^-)+c° k . lt if -2^ l ilJ3t(-^)+c 2 0 Jtn <2^ 1 / 

d x d 1 
Int(-±) +c 2 °jm-2«, if Int(-±) + 

d 1 d 1 
Jj3t(-^-)+c 2 Vi + 2^ if Int(-^-)+c 2 Vi<-2^. 



(2.7) 



While the reconstruction algorithm (2.3) and 
(2.5) will be implemented by the computer itself as 



c*-Int(-±), if -2*- l ic£-Int(-±-) <2<*, 

2*+[cZ-Int{2±)\ if c£-Int{?i)<-2*-\ a8) 
\ 2 y 2 

(c^-JaC^)]^*. if c£-Int{^-)>-2«-\ 



c? k = 



d?+c2 k . lt if -2***d£ + c 2 Vi < 2*"\ 

+ if dt + ci^-2*- 1 , (2.9) 



It is obvious that (2.8)- (2.9) are just the reverse of 
(2.6)-(2.7). It is also easy to see that if we properly 
0 take advantage of the bound in the coefficient size 

mentioned above, the algorithm can be implemented using a 
minimal amount of storage. 
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The following are examples which give motivation 
for our new approach • 

Example 3 : A (2.6) wavelet transform by integer 
calculation (2) . 
5 This transformation is similar to using the 

following analysis filters: 



n 


-2 


-1 


0 


1 


2 


3 


*. 


0 


0 


1/2 


1/2 


0 


0 












3n 


-1/16 


-1/16 


1/2 


-1/2 


1/16 


1/16 



(a) Decomposition 
10 Decomposition starts with Example 1 at step (1) 

and (2), and then upgrades the high frequency component 
at step (3) : 
( 1 } Compute 



15 



(2) Compute 



Curl™ 

(3) Compute 



Int( — — ) , + CjJ-x , if N is an even number, 



if N is an odd number; 



4 



and then, if N is even, calculate 
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_ J J 
a^-i-J^n ) -G^-a, 

else, calculate 

a^-^Inti ) -d^. 

(b) Reconstruction 

The reconstruction algorithm is identical to the 
decomposition algorithm, except it is now running 
"backwards" . 

(1) Compute 

4 

and then, if N is even, calculate 

<? Wl -i-Xnt:( ) -dj^- 1# 

else calculate 

o^.i-^tt - ) -d^, 

(2) If N is an even number, compute 

d 1 ' 0 

or, if N is an odd number, we have 

d 1 ' 0 

cik^ci-lntl-j-) , Jc=0,...,tf a -2; 
wv-i-c^ . 

(3) Compute 
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We see in step (2) -(3) above, that they are just 
the same as shown for the reconstruction of the (2.2)- 
wavelet transform (Example 1) . 

Example 4 : A (1, 3) -wavelet transform by integer 
5 calculation. 

The following nonlinear transform is a variation of the 
transform which uses biorthogonal analysis filters: 



n 


-1 


0 


1 




1 


0 


0 












1/4 


-1/2 


1/4 


9 n 









(a) Decomposition 

This decomposition starts with the Lazy wavelet 
10 at step (1) and upgrades the high frequency component at 
step (2) : 

(1) Set 

dl « c 2 Vi , *=0 , ... , M 1 - 1 . 

(2) If N is an even number, calculate 



d l k =Int( c *\ c * >1 )-dl' 0 ,k=0,...,M 1 -2, 



Otherwise, if N is an odd number, calculate 
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(b) Reconstruction 
(1) Set 



(2) If N is an even number, calculate 



.o 



c&.^Int ( C2 ** 2 C2 ** 2 ) -dl, *=0 , M,-2 , 



Otherwise, if N is an odd number, calculate 



ci k ^Int( C2k ^ 2 )-d^ Jr-O,....^-! 



5 Example 5 : (5, 3) -wavelet transform by integer 

calculation. 

This transformation is also similar in function 
to using the biorthogonal analysis filters. It is given 
by 



10 



n 


-2 


-1 


0 


1 


2 




-1/8 
1/4 


1/4 
-1/2 


3/4 
1/4 


1/4 
0 


-1/8 
0 



15 



(a) Decomposition 

This decomposition starts with Example 3 at step 
(1) and upgrade low frequency components at step (2): 

(1) Set 
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ci'° B c} kl Jc-0,.. .,^-1 ; 



If N is an even number, calculate 



jl __o _1 

Otherwise, if N is an odd number, calculate 



-1 _ . , c£k +C 2k*2 

dk=lnt{ 



)-c 2k . lt £=0,...,^-! 



(2) If N is an even number, compute 



cl=cl°-lnt{ti^), ic=i,...,^-2, 

i i,o T fc , d i-2 +d i-i . 



Otherwise, if N is an odd number, calculate 



(b) Reconstruction 

( 1 ) Compute 
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cZ K =cl+Int{ ** * ), 

Then, if N is even, calculate 

0 1 t *./ ^-2 + < ^»i-i . 
c«-2 = c^lnt( 4 ) • 

else calculate 

(2) Compute 

o o 

C^Inti C2k ^ 2k * 2 ) -ti < *=0,...,Ma-2, 
Then, if N is even, calculate 

5 The PPP property for Examples 1-2 mentioned at 

the end of the previous section is also applicable for 
these three examples. It is obvious these three 
transformations are not really linear, but they are 
similar to the one using the corresponding filters given 

10 above. Especially, the filters in Example 3 and Example 
5 belong to, with minor modification, the group of the 
best biorthogonal filters for image compression. 

Also, from the above three examples, we can note 
that if we begin with integer (linear or nonlinear) 

15 wavelet transformations and then use some proper 
upgrading formulas, we can get other, much better 
integer, wavelet transformations for image compression. 

Lifting Scheme and Integer Biorthogonal Filtering 
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The Lifting scheme, discussed by W. Sweldens in 
"The Lifting Scheme: A Custom-Designed Construction of 
Biorthogonal Wavelet", Applied and Computational Harmonic 
Analysis, Vol. 3, No, 2, April 1996, is a recently 
5 developed approach for constructing biorthogonal wavelets 
with compact support. It can be used, with minor 
modifications, to create integer biorthogonal wavelet 
transformations. The following is an adaptation of the 
lifting scheme. 

10 Definition 1 . The set of filters {h, h, g, g}, a set of 
biorthogonal filters if the following formula is 
satisfied: 



VG>€R:J7?(G>)Ar'(G>) =1. 
[J2(<i>) A(<i)+7l) 

where /n(o>) 4 

[g(v) gr{<i)+n). 

and h{u) =J3 bk e ~ k< * and 9(u)=J^ffk e 



and similarly for jS{o)) , £((*>) and £r(o>) 



The following lemma is the main result of the 
lifting scheme [1] reported as corollary 6 in that paper. 
15 Lemma 1 . Take an initial set of finite 

biorthogonal filters (h, *h, q°, g) , then a new set of 
finite biorthogonal filters {h, h, g, gl can be found as 

£((*>) =£°((i>) +£(G))s(2o>) 
flr(o))=gr°{Q) -A<g>) s (2g>) . 

Similarly if we take {h°, *h, g, / g} as an initial set of 
biorthogonal filters, a new set of biorthogonal filters 
20 {h, ft, g, g) can be found as can be found as 
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h(<*>) =J3°(G>) +flr(o)s(20» 

^(o>) (o)) -5(g>)s{2g)) . 

Here s(a>) is a trigonometric polynomial and the 
corresponding filter s is finite, and so is IT (<•)) . 
Actually, regarding the filters (4.1) is equivalent to 

i 

or 

i 

5 Next we use the lifting scheme with minor 

modifications to create an integer, nonlinear, quasi- 

[eft 

biorthogonal, wavelet algorithm. Suppose is a 

[<£] idi) 

original signal, and are again its low and 

high frequency decomposition parts, obtained by using the 
10 filters {h, h, g, g}. 

If we use filters {£, g} for decomposition 
(analysis), the corresponding decomposition algorithm is 

a 

While the reconstruction algorithm will be 



6wO 
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C * A n-2Jc ^ d k9 n -zk 



related to the synthesis filter {h,g}- Here, parameters 
a c and a d are positive constants with <x c »a d =2. For 
example, in the situation of regular biorthogonal 
decomposition and reconstruction, a c =a d WT; and for 
Example 1 through Example 5 above, a c =l and a d =2. 

If the set of filters {h, Tl, g, g) is from (h, 
h°, g°, g) by (4.2b), then decomposition can be 
accomplished as follows: 

1. Calculate 



a 



10 2. Calculate 



The relative reconstruction scheme will be: 



1. Calculate 



(4-0 



2. Calculate 



C k K-2k ^ d k9n-2k 



(4-0 



Here, equations (4.3) and (4.6) are just the wavelet 
15 (inverse) transforms using biorthogonal filters {h, h, g, 
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g}. While (4.4) and (4.5) are forward and backward 
upgrading formulas. 

Similarly if the set of filters {h, h, g, g} is 
from the initial set of filters {h? h, g, g} by using 
(4.2b), the relative decomposition is: 

1. Calculate 



D 



2. Calculate 



a 1 



.0 



The reconstruction scheme is: 
1. Calculate 
1. Calculate 



2. Calculate 



°k9a-2k 



WO 98/40842 



PCT/US98/04700 



37 

Pnrol 1 ary 4.1. . Suppose bioxthoganal filters{h,R, g t g) 

are from initial filters{h,B 0 ,g° t g}by the lifting scheme 
(4.1a) or (4.2a) . If the decomposition and reconstruction 
by filters [h, fi° , g° , g) can be accomplished only by integer 
calculation, such as Example 2, we also can create a 
corresponding integer wavelet decomposition and recon- 
struction scheme which is very "close" to the original one 
by using filters {h,R, g, g t ) . Here the word n close" means 
that the difference of the two decompostion schemes 
is just some rounding error, and this rounding error will 1 
corrected by the integer reconstruction scheme. 

In fact, if {Ck'°} and {dty are integer after (4.3), 
we can calculate {c*} by 

instead of (4.4)* Here Int(x), as described in Section 
2, is an arbitrary rounding up function which satisfies 
x-1 s Int(x) £ x+1. It is obvious that (4.7) is very 
close to (4.4), and the exact reconstruction scheme can 
5 easily be obtained from 



and (4.6). There will be a similar result, if the set of 
biorthogonal filters {h, h, g, g) is obtained from the 
initial set of filters {h, h, g, g} by using (4.2b). 

Except for the example shown in the Lazy wavelet 

10 (Example 2), most standard biorthogonal wavelet forms 
cannot be performed directly by integer, even for one of 
the simplest wavelets, the Harr wavelet. However, if the 
parameters a c , and a d are properly chosen and the 
transform algorithms, such as Example 1 and Example 3, 

15 are slightly changed, a variation of the original 
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biorthogonal wavelet transforms with respect to the set 
of filters {h, h, g, g) is created. On the other hand, 
the parameters should be also chosen carefully to 
guarantee that only addition and shift operations are 
5 needed by the algorithm. 

If the set of filters {h, h, g, g) is obtained 
from a set of filters {h°, h, g, g} by the lifting scheme, 
and the set {h* h, g, g} is also obtained from a filter 
set {h, h* q, g}, one can repeatedly use Corollary 1 to 
10 get a "close" integer wavelet transformation. 

The Correction Method for Creating 
Integer Wavelet Transforms 

Another approach for obtaining integer wavelets 

is using the so-called Correction method. The motivation 

15 of this method is from the S+P transform. The lifting 
scheme for generating biorthogonal wavelets can be 
considered as a special case of the correction method. 
From this can be derived complicated filters with fast 
decomposition and reconstruction algorithms. 

20 Assuming a simple integer wavelet transform, 

such as Examples 1 through 3, the decomposition and 
reconstruction scheme of which can be formulated as 
follows : 

Decomposition 

0}-'-dI t ({c„°}) 

25 Reconstruction 

Here, (5.1) and (5.2) can be the same as (4.3) and (4.6) 
or other algorithms. 

In general, after the above decomposition, one 
may not be satisfied with the result. There may still be 
30 some correlation among the high pass components because 
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of the aliasing from the low pass components, or the low 
pass components do not carry enough of the expected 
information from the original signal. Hence, one could 
make an improvement by putting some correction part on 
5 the high pass components or low pass components. There 
are many ways to accomplish this. However, for the sake 
of the integer calculation, it is preferable to use 
following correction method. To make a correction for 
the high pass part, the corresponding formula would be: 

d}=d} §0 -Int(dc£ 9 $k-~-, 0,1,2-. (5.3) 

10 Here, dc k l is a correction quantity for d* 1 



o, c&° T,d# , *-« ,0,1,2,- (5.4) 



and \ IjsSa and f are given parameters which 

have been chosen for the user's purpose such as reducing 
the redundancy among high pass components or some other 
special requirement. To preserve the integer 
15 calculation, any entries in both 

\^ and J" ^Ayl should be rational numbers with 

denominators being powers of 2. 

From (5.1), (5.3) and (5.4), it is easy to see 
the perfect reconstruction algorithm can be 

d];' 0 =dj;+In t(dc k ) , ,m,m-l, m-2 - , (5.5) 



20 combined with (5.2) . 

As mentioned above, the Lifting scheme is a 
special condition of the correction method. Examples 3 
through 5 can also be considered as the examples of this 
method. We next give an example of the Correction method 

25 which cannot be included in the group of Lifting scheme, 
and also which does not result in a closed form of 
compact support for biorthogonal filters. 
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Example 6 :. S+P transform, which is similar to 
using following analysis filters. 
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While the synthesis filters do not have compact 
support, the S+P transform can be implemented as follows: 
(a) Decomposition 

(l)Take the decomposition step of Example 1, 
10 that is, compute 



and 



C S-1 i 



(2) Correction Step: Define S 0 ■ -1, S, = 1, T = 1 and 
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and now compute 



(b) Reconstruction 

(1) Compute 



(2) If N is an even number, compute 



or, if N is an odd number, we have 
c 2 Vi *cl - In t|-^ j , k=0 , , N x -2 , 



(3) Compute 



Boundary Conditions 
There are two issues dealing with boundary 
filtering if the Lifting scheme or the Correction method 
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is used to generate the integer wavelet transformations. 
The first is how to process the boundaries which occur in 
the start-up wavelet transformations. The second is how 
to deal with the boundaries in the deductive formula. If 
5 the boundaries in the start-up wavelet transform have 
already been established, then those in the upgrading 
formula are relatively easy to establish. For the 
Lifting scheme, the boundaries in both steps should be 
processed in the same way. While, for the Correction 

10 method, according to (5.3)- (5.4), one has more choices to 
process boundaries in the second step. Therefore, the 
process by which the boundaries in the start-up wavelet 
transformations are established is discussed. Assume 
compact supported biorthogonal wavelets. p * k> 

15 Suppose the original signal is ^ i a^s For 

creating integer biorthogonal wavelet transformations, 
use the following symmetric extension: 

(1) If current biorthogonal filters have even 
length, the boundaries of the signal are 

20 extended as f = Cr , '» z > • * * / 

(2) If the filters have odd length, the 
following extension is performed 

Examples 1 through 5 use the boundaries given 
25 above. In Example 6, the start up wavelet transform uses 
the above boundaries but in the upgrading step, another 
boundary filtering is used. In addition, for arbitrarily 
sized images or signals, one can use the same technique 
described in the above examples to deal with this 
30 condition. 

As mentioned earlier, for many applications, 
lossless image compression is more important than lossy 
compression. The integer wavelet transforms described 
above provide the opportunity to compress without loss. 
35 It is also obvious that the integer wavelet algorithms 
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can be used wherever, ordinary wavelets are used, 
especially in signal and image compression. However, for 
most computers, the integer wavelet transform is much 
faster than other wavelets and it uses much less memory. 

5 Peak Signal to Noise Ratio (PSNR) 

Controlled Compression 

Peak Signal to Noise Ratio (PSNR) is a widely 

used quality measurement. PSNR controlled compression 

allows users to choose their desired PSNR for the 

1C compressed image. In each of the compression methods set 
forth herein, a user can selectively set the PSNR and the 
desired compression ratio, as well as the initial 
quantization and threshold levels for each quadrant of 
wavelet coefficients, to obtain the desired image 

15 quality. 

For example, the wavelet map of FIG. 3 shows a 
total of 10 regions (quadrants) . Each of these ten 
quadrants can have two additional parameters associated 
with them. The parameters define the quantization and 

20 threshold values for that particular quadrant. Since 
there are three planes for color (only one for gray 
level) the maximum number of parameters that the user can 
control is 60 — 10 for quantization and 10 for 
thresholding for each of the three color layers. In the 

25 case of a gray level image, there are only 20 parameters. 

If a compression ratio, or a quality factor 
which indirectly defines a compression ratio, is 
specified, then the user wants the compression ratio to 
remain identical over the changes in the parameters. In 

30 order to accomplish this, two parameters are monitored: 
the compression ratio and PSNR (peak signal to noise 
ratio). The PSNR is defined as PSNR = 20 log 10 (X/MSE) , 
where the X is the average absolute value of the pixels 
in the compressed image and MSE is the mean squared error 

35 measured between the compressed and original image. 

Holding the compression ratio constant, the PSNR needs to 



WO 98/40842 



PCT/US98/04700 



increase to improve image quality. The way to increase 
the PSNR is to reduce the MSE. 

An iterative method can be used to adjust 
parameters to achieve the desired PSNR, The step are as 
5 follows: 

(a) Pick an initial parameter setting P 0 ; 

(b) Quantize the wavelet coefficients with P 0 
and calculate the corresponding PSNR; 

(c) If the PSNR is close to the desired one, 
10 stop and output the coded file; otherwise, get 

an adjusted vector AP 0 and set P 0 - P 0 + AP 0 , 
go to step (b) . 

Progressive Decomposition 
Progressive decompression allows users to decode 

15 images at varying degrees of resolution, starting from 
the lowest resolution and progressing to the highest 
resolution. The advantage of this feature is that users 
can download small pieces of the coded file and view the 
image at lower resolution to determine if they want to 

20 download the whole image. Progressive decomposition can 
be used with any of the decompression methods previously 
disclosed herein. Progressive decomposition is 
accomplished according to the following steps: 

(a) Input the lowest bandpass component C 1 of 
25 the coded file and reconstruct the lowest 

resolution image 1°; 

(b) Display image 1°; 

(c) If the user is not satisfied with the image 
quality or the resolution is big enough for 

30 stop; otherwise, go to step (d) ; 

(d) Input the lowest three band-pass components 
HD 1 , VD 1 , and DD 1 successively in the current 
image file. Reconstruct the new image I 1 from 
C 3 , HD 1 , VD 1 , and DD 1 . Let 1° = I 1 ; go to step 

35 (b). 
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• Image Map Editor 
The image map editor creates an image map over a 
compressed image file. This permits an image compressed 
according to one of the methods set forth herein to be 
5 easily integrated into a web page using an http link. A 
user selects one or several areas of compressed image, 
assigns one or more http links to the areas. The image 
map editor calculates the coordinates of the areas and 
outputs the HTML associate with the image. The user can 
10 add such information into program source code. Following 
is an example of such image map: 

< EMBED SRC="cow.cod" type=" image/cis-cod" 
WIDTH="257 n poly= "44, 45, 103, 78, 103, 86, 54, 
86, 54, 78", 

15 href ="http: //www. inf inop .com"X/EMBED> 

Non-Uniform Image Compression 
The present invention allows a user to perform 
non-uniform image compression. Essentially, non-uniform 
compression is accomplished by dividing an image into one 
20 or more rectangles, each representing a matrix of image 
pixels. Each rectangle can be compressed by any of the 
methods disclosed herein. 

For instance, referring to the compression 
method of FIG. 8, integrating the non-uniform compression 
25 feature with the method allows a user to partition the 
image into several parts with different interests. The 
user can then compress these areas with different image 
and/or compression qualities. The parts can have any 
shape. 

30 The non-uniform compression feature can be 

incorporated in to the method of FIG. 8 as follows. 
Steps 100-102 are performed. Then, the user creates 
bitmap matrices defining the partitioned areas. Each 
area is then wavelet transformed. Different 

35 quantizations are then applied to the different areas 
according to the transformed matrices obtained above. 
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Split and Merge Wavelet Algorithm 
for Big Image Compression 

This algorithm allows users to compress large 
images by partitioning them into smaller pieces. The key 
5 is to divide the original image into several smaller 
pieces and compress/decompress them separately by using 
overlap and de-overlap technique. With this technique, 
the individually compressed pieces are equivalent to 
compressed whole image. The user does not see any edge 

10 effects in the decompressed image, which normally occur 
with conventional split and merge methods. 

Also, with this algorithm, users can selectively 
decompress the whole image or choose a specific part to 
decompress according to an image map created during the 

2 5 compression phase. The algorithm is preferably 

implemented as a software program executing on a general 
purpose computer. 

There are two ways to compress an image by 
splitting it: automatically or interactively. The 

20 automatic approach is transparent to users since the 

algorithm will automatically split to the image according 
to the characteristics of the computer used to perform 
the compression. Using the automated method, the 
algorithm first detects the size of the source image and 

25 the memory size of the host computer. Next, the image is 
split into several pieces with a predetermined number of 
pixels overlapping according to the image size and 
computer's memory. Overlapping pixels are those that 
appear in more than one piece of the split image. 

30 Each piece of image is compressed in order 

according to any of the methods disclosed herein from the 
image resource. 

The split image is decompressed as follows. 
First, the headers of the compressed image pieces are 

35 read to determine their order and compression parameters, 
such as quantization thresholds and decomposition levels. 
Next, each piece of the image is decompressed and de- 
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overlapped. Merge all pieces together in the proper 
place for display. 

Using the interactive method, a user can 
indicate how many blocks they want to divide the image 
5 into and how many pixels they want for overlap. To 

compress an image according to this approach, the size of 
the source image is first detected. Then, the user's 
choice for the number of blocks and number of overlapping 
pixels is entered. Next, the image is divided into the 

10 pieces according to the user's choice and the size of the 
image. Finally, the individual pieces are compressed 
according to one of the methods disclosed herein. 

The interactively split image is decompressed as 
follows. First, the header of the coded image is read. 

15 Next, an image map is displayed for the user to look at 
what the image context is about. The user can then 
choose to display entire image or a specific piece of 
image. If user chooses to display a single piece of 
image, the algorithm finds the position of this coded 

20 piece and decompresses it. If the user instead chooses 
to display the entire image, the algorithm decompress 
each piece of image and de-overlaps it. All pieces are 
then merged together in the appropriate display location. 
Example A, below, shows further technical 

25 details related to the present invention. 
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While specific embodiments of the present 
invention have been shown and described, it will be 
apparent to this skilled in the art that the disclosed 
invention may be modified in numerous ways and may assume 
5 many embodiments other than the preferred form 

specifically set out and described above. Accordingly, 
it is intended by the appended claims to cover all 
modifications of the invention which fall within the true 
spirit and scope of the invention. 



10 
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1.0 Quality Compression Optimization 

The following sections deal with the improvement of the compressed 
image quality. As stated in the report introduction, we believe this is 
the last significant major problem to be addressed in the still 
imagery compression system. 



1.1 Introduction 

The issue is the mechanism which can be used to improve the quality 
of the image based upon the nature of the parameters used in the 
compression process. Wc think this is an important issue, and in our 
experimentation, wc have found fairly striking results. For example, 
if we hold the compression ratio constant, we can compress an image 
and obtain on a subjective scale of C t where 

• A is no observable defect, 

• B is observable but not noticeable, 

• C is quite noticeable, but not distracting from the image, 

• D is very noticeable and detracts from the image, 

• E is unacceptable. 

If wc now change the parameters by a hand optimization, we find we 
can change the subjective evaluation from a C to a B with the 
compression ratio left alone. We believe this is significant, in that it 
guarantees a compression system which is tailored for each image 
independently, rather than have each image compressed by the same 
set of parameters irrespective of the image content. 

To review the process of compression, consider the following figure. 
Figure 49, 
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Figure 49 

RGB Image in 24 Bit Color Depth Showing Transform to YIQ 



Figure 49 shows the relationship between the RGB and YIQ color 
representation and the processes which take place in the algorithm 
as this data is transformed into the final lossy set of wavelet 
coefficients.. The processes which apply to the imagery are shown as 
heavy arrows wiih the process identifier shown as part of the arrow. 
If no process number is present, then the arrow is just a passive link 
between processes and data. The important point to note is that in 
color imagery, we deal with three images (one luminescence, and two 
color planes). The Y component is critical, while the IQ components 
are less sensitive to error introduced by the compression system. 

The processes shown in Figure 49 are as follows: 

• (I) Transform the RGB format into YIQ format, using long 
integers. This format is only an approximation of the YIQ format. 

• (2) Transform the YIQ planes into a wavelet decomposition using 
our own integer wavelet transform. This produces the result 
shown in Figure 50, but for each plane. 

• (3) Wc have shown an alternative process which is an optional 
down sampling for the IQ color planes. This down sampling may 
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be done once or twice to produce two image planes either one 
fourth or one sixteenth the size of the original plane. If this 
process is to be done, it will be accomplished prior to the wavelet 
transform of process (2). 

• (4) Here the first step in the loss occurs. The wavelet coefficients 
are now quantized to a number of levels depending upon which 
quadrant is being processed, and the desired compression or 
quality factor. 

• (5) Simultaneously with step (4), the wavelet coefficients are 
being matched against threshold values, and if the values are less 
than the established threshold values specified, then the resultant 
value is set to zero. 

• (6) The last step in the process is to entropy compress the 
resultant coefficients using cither Arithmetic, Run Length, or 
Huffman, of Huffman and Run Length combined. The key issue is 
the amount of compression desired against the invested time 
required to get that level of compression. 

The issue now, irrespective of the down sampling or not of the IQ 
components, is the fact that we process the three planes into five 
levels in a decomposition as shown in Figure 50. From this figure, 
one can see a total of 16 regions (quadrants) which are defined by 
the numbers 1 through 16. Each of these sixteen quadrants have two 
additional parameters associated with them. The parameters define 
the quantization and threshold values for that particular quadrant. 
Since there are three planes for color (only one for gray level) the 
maximum number of parameters that the user can control is 96 16 
for quantization and 16 for thresholding for each of the three color 
layers. In the case of a gray level image, there are only parameters 
for one layer. 

Our experience has shown the parameters for an image are very 
sensitive in some cases, and not in other cases. In order to measure 
this sensitivity, we generated the variance of the wavelet coefficients 
in the 16 quadrants. Table 1 provides these values for each of the 
three planes. 
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Figure 50 

Decomposition of a Plane into Five Levels 
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Table 1 

Wavelet Coefficient Variance by Numbered Quadrant for Two Images 
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The clear information to be gained by the numbers in Table 1 is the 
images are quite different, and the quantization or threshold levels 
set for all images will only be an approximate solution at best. The 
optimum solution would be to have the quantization and threshold 
values set according to the variance values. Such settings could be 
found in a table with various ranges, and for each such range, the 
parameter* of interest could be defined. This would give a more 
opuxnal solution, but still not the optimal solution. In order to get 
opumality, one would need to search over the variable space using 
the near optimal settings to find the actual best values for the 
parameters. 

As the values in Table 1 grow, the implication is a finer mesh size for 
quantization. That is, the number of bits one wishes to allocate to the 
output could be varied by quadrant. Those quadrants with large 
variances will utilize more bits, while those with low variants will 
utilize fewer bits. In this way, the number of bits resulting from 
quantization will remain the same, but their allocation will differ 
depending upon the nature of the image. 

1.2 Approach 

The solution to the problem posed in the previous section is to 
determine how the ninety-six parameters interact with one another. 
The problem is a bit more sophisticated than just measuring 
parameters, however. The issue is with each parameter change, the 
compression ratio will change. If a compression ratio, or a quality 
factor which indirectly defines a compression ratio, is specified, then 
the user wants the compression ratio to remain identical over the 
changes in the parameters. In order to accomplish this, there are 
two parameters which we must monitor: PSNR (peak signal to noise 
ratio which is defined to be PSNR = 20 logio (X/MSE) where the X is 
the average absolute value of the pixels in the after image and MSE 
is the mean squared error measured between the before and after 
image) and the compression ratio. The compression ratio must be 
held constant, and the PSNR needs to increase, and the way to 
increase the PSNR is to reduce the MSE. 

The difficulty with this system as described is in many cases, small 
changes in the parameters introduce significant changes in the MSE. 
Also, we believe, the parameters are not independent. We have also 
seen images where the parameters can be changed in one way, then 
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altered, and the results are exactly the same. This indicates the 
optimal value is not a single point, but rather something like a plane 
with little slope. 



1.3 Status 

We have established the rules under which the optimal solution will 
need to exist, and are at the moment writing software to measure the 
variance within the Lightning Strike environment. Once this is done, 
we will being examining many images to sec how close we can 
determine the optimal parameters for a defined set of variances. 
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CIS-2 Image Compression Algorithm 
HONGYANG CHAO 
Part I: Brief Review of LSIC 3.0 

1. Introduction 

CIS-2 (temporary name), which has been being used in Lightning Strike 3.0 image 
compression software, is a wavelet based image compression algorithm. CIS-2 has 
following inventions: 

• Integer reversible wavelet algorithm with Property of Precision Preservation; 

• Subband oriented quantization and related entropy coding; 

• Wavelet lossless compression for color and gray images; 

• Progressive transmission algorithm for color bit compression; 

• Progressive transmission and decompression algorithms; 

• Non-uniform image compression algorithm; 

• Quality based wavelet coefficient quantization tables; 

• Attached optional post-processing filters; 

• Image map editor; 

• Optional peak signal noise ratio controlled compression; 

• Special split and merge wavelet compression algorithm for very big image 
compression without any boundary effects ; 

• Image dependent parameter optimization . 

2. Main stepi of the algorithm 

In Lsic 3.0, three kinds of different image compression methods arc included: 
Method I : Quality controlled wavelet based compression 
Method 2: Color bit depth compression 
Method 3: Wavelet lossless compression 

Section 2. 1-23 will give brief description of above method. The details will discuss 
later. 

2.1* Main step of method 1 

Figure 1 and Figure 2 give the flow charts of the image compression and 
decompression of method 1 respectively. Every step in both compression and 
decompression has lot of details, which will be described later. 
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Figure 1: Compression flow chart for Method 1 
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Figure 2: Decompression flow chart for Method 1 



22. Main step of method 2 

This method based on using less number of colors to approximately represent 
original images. Following figure gives the main step of the algorithm for the 
compression and decompression. 
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Figure 3: Compression flow chart for Method 2 
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Figure 4: Decompression flow chart for Method 2 

2J. Main tup of method 3 

The main steps of method 3 is almost as same as method 1. However, at the every 
step we use different methods. Following are its compression and decompression 
flow charts: 
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Figure 5: Compression flow chart for Method 3 
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Figure 6: Decompression flow chart for Method 3 



3. Brief Description for Other Features 

Most Features (or inventions) are included in above three compression methods. 
Following is the brief introduction for some inventions list above. 
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3.1. Progrcnivc decompression 

This algorithm allows users to decode images from the lowest resolution to 
highest resolution. The advantage of this feature is that users can download small 
piece of the coded file and view the image at lower resolution to determine if they 
want to download the whole image. 

Steps: 

(a) Input the lowest pass component LL* of the coded file and reconstruct the 
lowest resolution image 7° ; 

(b) Display image /* . If the user doesn't like it or the resolution is big enough for 
f stop; otherwise, go to next step; 

(c) Input the lowest three band-pass components HL\ Ltf °and HH° 
successively in the current coded file. Reconstruct the new image /' from 
LL\ HL\ LH* and HH*. Let /°- /' , go to step (b). 

3.2, NoD-uoifonn image compression 

The algorithm allows users to divide the image into several parts with different 
interests and compress these areas with different qualities. The areas can have any 
shape. This algorithm is only available for method 1. 

Original image goes though all of the procedure except quantization pan. which 
follows the steps below: 

(a) Creating the bitmap matrices related to the areas chosen by the user; 

(b) Wavelet transform to every bitmap matrix; 

(c) Different quantization in different arras according to the transformed matrices 
obtained above step. 

3J. Peak Signal Noise Ratio (PSNR) cootroUed compression 

Peak Signal Noise Ratio (PSNR) is an image quality measurement used by most 
professional people. PSNR controlled compression allows users to choose their 
desired PSNR for the compressed image. 

The related algorithm is an iterated system: 

(a) Picking an initial parameter setting P 9 ; 

(b) Quantize the wavelet coefficients with ? 0 and calculate the corresponding 
PSNR; 

(c) If the PSNR is close to desired one, stop and output the coded file; otherwise, 
get an adjusted vector A? 0 and set P 9 «- P 0 + A/> 0 , go to step (b); 
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3.4. Attached optional pott-processing filters 

Users can choose any number of following processing filters at their compressing 
time. The desired results can stored in the coded image file, and, anyone who 
decompress the coded file will see the same result immediately. 

• Sharpening images 

• Smoothing images 

• Improving the visual quality 

• Brightening the images 

3 .5. Image map editor 

Image Mep Editor create a image map over Lsic3.0 compressed image file. User 
selects one or several areas of compressed image, assigns the http links to the areas, 
then. Image Map Editor calculates the coordinates of the areas and outputs a HTML 
associate with the image. User can add such information into his/her source code. 

Following is an example of such image map: 

<EMBED SRO M cow.cod" type = "imagc/cis-cod" WIDTH- "257" poly= "44, 
45, 103, 78, 103, 86, 54, 86, 54, 78", href* "http-y/www.infinopxom"x/EMBED> 

3.6. Split and merge wsvclct Blgoritbra for very big image compression 

This algorithm allows users to compress very big image by an ordinary machine. 
The key is to divide the original image into several smaller pieces and 
compress/decompress them separately by using overlap and dis-ovcriap technique. 
With this technique, the compression/decompression piece by piece is equal to 
compress/decompress the whole image together, which means users won't see any 
edge effect at decompressed image which appears at general split method. 

Also, with this algorithm, users can either decompress the whole image or choose 
the specific part to decompress according to a image map we create for the division . 

3.7, Image dependent optimized parameter setting 

This algorithm allows user to get the best (or almost best ) image quality at the 
desired compression ratio by choosing image related parameter setting. 

3JL Integer reversible wavelet algorithm with PPP property 

See attached unpublished paper tided as "An Approach to Fast Integer Reversible 
Wavelet Transformations for Image Compression" 
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3.9. Isitgtr color fraufonnatioo 

This algorithm is a integer reversible transform which has been used in lossless 
color image compression (Method 3) for Lsic 3.0. 

The algorithm transform RGB color components to a new set of color 
components Y-Nb-Nr: 

Forward transform RGB to Y-Nb-Nr; 

r = G' + Int(Y). 
M>-5-Int(f), 

M>«*-Int(f). 
Inverse transform Y-Nb-Nr to RGB: 

Rm JVr + Int(f), 

fl = W + Int({), 
G=r-lnt(-^). 

3.10. Sobband rrlaud Quantization and entropy coding 

This entropy coding method is just designed for wavelet based image 
compression. The main idea is to take the advantage of different quantization at 
different subbands and encode each band according to its content This method 
reduce the coding cost gready. 
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CLS-1 Image Compression Algorithm 

HONGYANG CHAO # 
Computer and Information Science Inc. 

1. Introduction 

ClS-1, which has been being used in Lightning Strike image compression software, is a 
wavelet based image compression algorithm. CIS-1 has following advantages: 
o Reach almost optimal compression ratio; 

o Keep the major characteristics as more as possible. In other words, it reduce 

insignificant components gradually according to human visual system, so that people 
can still accept the image quality at the extremely high compression ratio; 

o Fast 

2. Main steps of the algorithm 

Figure 1 and Figure 2 give the flow charts of the image compression and decompression 
respectively. Every step in both compression and decompression has lot of details, which 
will be described later. 



Input Original Image 




t 




Display Image 






Image Transformations 



Quantization and Thresholding 

Encoding 
Output Coded Image File 



Figure 1: Image compression 
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Inp ut Code d image file 
Decoding 

■ V 

De-quantization 



jiiverse Image Transformations 

, i 

Post Image Processing if Necessary 
Display Compressed Image 



Figure 2: Image decompression 

3. Image Compression 

For the compression, we only have to describe three parts: image transformations, 
quantisation and thresholding, and entropy coding. 

3.1. Image Transformations 

The image transformations involved in this algorithm include color transform (for color 
images) and wavelet decomposition ( for both gray level images and color images). 

(a) Color transform 

In general, input color images are based on RGB color model, such as 

TIFF or BMP images. In order to get high compression ratio, it is better to change RGB 

color model to other color models, such as YIQ or YUV models, 

RGB to YIQ: 

fyl T0.299 0.587 0.114 T*l 
1/ U 1 0.596 -0.275 -0.321 1 G I. 
IfiJ Lo.212 -0.523 0.311 IsJ 

RGB to YUV: 
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m T0.299 0.587 0.114T^1 
lt/UI-0.148 -0.289 0.439 I G I. 
[v\ Lo.615 -0.515 -0.1 IsJ 



(b) Wavelet decomposition 

The purpose of wavelet transform is to represent the original image by different basis to 
achieve the objective of decollation. There are a lot of wavelets which can be used in 
this step. In CIS-1, we use a wavelet which results in the following algorithm: Suppose 
C°x=[cJ]^ (/»0 f - f Jl/-l; * = Q,~%N - 1) is original image, where MtndN arc 
integers which have the common factor 2 L {L is a positive integer). After one-level 
wavelet decomposition, we will get four parts as shown in figure 3. 




Wavelet 



Transform 



6 


HD 1 


VD 1 


DD 1 



Figure 3. Wavelet image decomposition 

We call C 1 = [cj,] (/ = 0, • ¥ - 1 ; it = 0,- -A - 1 ) the blurred image of C° , HD 1 the 
horizontal high frequency part of C°, VD 1 the vertical high frequency part, and DD 1 the 
diagonal ones. Setting C° = C 1 , we can repeat the same procedure L times or until the 
size of the new blurred image C 1 is small enough. Therefore, we only have to give the 
algorithm for one level decomposition: 

(1) Let C° » rC° , r >0 is a factor which can be changed for different needs. 

(2) Transform for image columns: 
o For Jt-0 t - 1, calculate 

. 2 C3.1.1> 

o For it* 0,- calculate 



WO 98/40842 



PCT/US98/04700 



64 



| C 0J = c \*~ 



2 



-I -o "ft ~ r *'l*\t 

c jk - c j;*u ~ « 



(3) Transform for rows: 

o For computing 



. y = l.-.¥-2, (3.1.2) 



Ko = 



(3.1.3) 



and 



r, 



c jo - C J.\ ~ 



j , -I fa/'j + 

i c ;» =c yji.i > ' 

t 

o For y = 0,—,^-l, computing 



-2. (3.1.4) 



1 



1 



(3.1.5) 



and 



\ vd fi- d j.i j 

I 



\< = d).»«- ** hi ~f^\ *=l.-,*-2, (3.1.6) 



(4) d = [e],} HD' = [hJ> u J VD' = [vdj..] and DD 1 = f^.,], y = 0. * - 1 ; 



Remark: If it is necessary, we also can use matrix multiply 

Wavalet Coefficient Image of /levels » W,C 0 Wj. 
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Here, W, is the transform matrix for / level wavelet decomposition, 
li Thresholding and Qusntization 

Both thresholding and Quantization allow us to reduce accuracy with which the wavelet 
coefficients are represented when converting the wavelet decomposition to an integer 
representation. This can be very important in image compression, as it tends to 
many coefficients zeros— espcciaUy those for high spatial frequencies. 

After L level, for example I«°3, wavelet decomposition, we get the wavelet coefficients 
of the original image as plotted in Figure 4: 



c 3 


HD 3 


HD 2 


HD 1 


VD 3 


DD 3 


VD 2 


DD 2 


VD 1 


DD 1 



Figure 4. L-3 wavelet coefficients distribution 



(a) Thresholding 

In algorithm CIS-1, we use multilevel uniform thresholding method: Let 

be the chosen thresholds, where /, is the threshold for / th (/ = 1,- • -,!) level and / x+l is a 
threshold for blurred image . Thresholding is to set every entry in the blocks C 1 , 
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HD', VD 7 and DD' (/ = 1, •••,£) to be zeros if its absolute value is not greater than the 
corresponding threshold. 

Remark For color image, we can have three threshold vectors which correspond three 
different color bands, such as Y, I and Q. 



(b) Quantization 

Quantization is to scale the wavelet coefficients and truncate them to integer values. In 
CIS-1, we use the quantization table shown in Table 1 to implement it 



-1 

1m 




• • • 






q ? 




• • • 


ql ? 


















• • • 


<?r>r> 





Table 1. Quantization table 
Here, the entries q^ are quantization factors for blocks HD' (/ = » q^ and q' DD 
for blocks VD' and DD' (/ = 1, • • -,I) respectively, and the factor q£ x is for the most 
blurred image C 1 . All the factors are integers between 0 and 255. The quantization 
scheme for the block HD' (/ « 1, •••,!) is 

hdtv round fa =0. Jfc«0,- f # -1. (3.2.1) 

msXfgf 

Here, hclj* (j - 0, • • •, % - 1; k - 0,- • ;f - 1 ) are quantized wavelet coefficients in block 
HD' (/ = !,. •,£), 

0«*<(*/}'-1) 

and the function round (x) gives the nearest integer of x . The scheme of quantization for 
other blocks are the similar to (3.2.1). 



Remark For color image, as the same as thresholding, we can have three separate 
quantization tables for different color bands. 



3.3. Entropy Coding 

Here, the encoding means the lossless compression for the wavelet coefficients. It is 
divided into two parts: Coefficient arrangement and entropy coding (Huffinan or 
arithmetic). 
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4. Decompression 
4.1 Decoding 

Decoding, just as encoding, can be divided into two parts: Entropy decoding (H uffm a n or 
arithmetic), and coefficient rearranging. 



42 DequaathAtloo 

After Decoding, we get quantized wavelet coefficients in 3 Blocks. Dequantiring 
uses the same quantization table as quantizing, and the scheme as follow: for / «= l t mm ;L 

bA*- ^'*^ m .j-0."tf : -ll *«0 f .».f-l. (4.2.1) 

(4.2.1) allows us to get the approximate coefficients for the blocks HD (/ = !,•••,!) . 
which is shown in Figure 4 . The dequantiring scheme for other blocks are similar to 

(4.1.2) . 

4 2 Invent Image Transformations 

(a) Wavelet reconstruction 

We are going to describe the algorithm for one-level reconstruction which is plotted in 
Figure 5. 



Inverse Wavelet 


d 


HD 1 


Transform 


VD 1 


DD 1 



Figure 5. One-level wavelet reconstruction 



(1) Inverse transform for rows: 
o For calculate 

'51 Jl » J* 0 

|fl/.i= v ^.o+ 5 



V 

\'d)^^ ^ k 'f'^ , * = l,-.-?-2, (4.3.1) 
I. 

i 



and 
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o For = 0,— ,^ -1, calculate 



(4.3.2) 



(4.3.3) 



and 



(2) Inverse transform for column: 
o For k « 0,- -',N - 1 , calculate 
L, 

jc u , 



and 



(4.3.4) 



(4.3.5) 



(4.3.6) 



(b) Inverse color transform 

For color image, we have to do inverse color transform 
o YIQ to RGB 

\R\ Tl-OOO 0.956 0.621 Til 
I G I = 1 1.000 -0.272 -0.647 II 1 1 . 
[b\ Ll.000 -1.106 1.703 JLcJ 
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(4.3.2) 



o For ;' = 0,-,^-l. calculate 



2 



and 



I 



(4.3.3) 



(4.3.4) 



(2) Inverse transform for column: 

o For k = 0,- -,N - 1 , calculate 

2 



|C U =C M + 



(4.3.5) 



-0 -I . jl 



and 



(3)^=^/r. ;=0,...,A/-1; *-0,...tf-l. C -[c^. 



(4.3.6) 



(b) Inverse color transform 

For color image, wc have to do inverse color transform 
o YIQ to RGB 

[R\ Tl.OOO 0.956 0.621 Jrl 
IgUIi.000 -0.272 -0.64711/1. 
UJ Ll-000 -1.106 1.703 JlfiJ 
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o YUVtoRGB 



[R] Tl-OOO 0.000 L140T31 
I C 1 = 1 1.000 -0.395 -0.581 \U I 
Ib} Ll.000 2.032 0.000 J. H 



4.4 Neccmty Post Image Proccuing 

(a) Color Quatization 
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Abstract 



In this paper we propose a general method for creating integer wavelet transforms which can be 
used in both lossless (reversible) and lossy compression of signals and images with arbitrary size. 
This method allows us to get a scries of transformations which are very close to the corrcsDondjng 
biorthoeonaJ wavelet transforms or some non-orthogonal wavelet transforms, but can be calculated 
with only integer addition and bit-shift operations. In addition, the integer wavelet transforms 
created in this paper possess a property of precision preservation (PPP). This property ts very 
useful for conserving memory in both compression and decompression, and speed up the wbole 
procedure in some applications. The motivation of this paper comes from the lifting scheme [1 J 
and S+P transform [5 J. 



* This work has been partially supported by the US Navy under SBIR Contract N00039- 
94-C-0013. 

The author is partially supported by the National Science Foundation of P. R. China 
and the Science Foundation of Zhongshan University. 
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1. Introduction 

The wavelet transform has proven to be one of the most powerful tools in the field of image 
compression. Theoretically, the wavelet transformation is lossless, but since all computers have 
only finite precision, most of transformations are lossy in practice, even when we use floating 
point calculations. On the other band, integer calculations are much faster than floating point for 
virtually all computers; and integer computations are much easier to implement in hardware which 
is more important in some applications. The memory utilization of integer* is also a positive 
consideration. The difficulty is f if we directly use integers in the wavelet transform and its inverse 
without some proper considerations, it will cause the loss of accuracy. For some important image 
applications, the user wants to have complete control of the precision in which the image pixels are 
represented during the compression process, and thus prefers to have the image compressed from 
lossless to lossy. 

Lossless compression is also very important for images found in such applications as 
medical and space science. In such situations, the designer of the compression algorithm must be 
very careful to avoid discarding any information that may be required or even useful at some later 
point From the academic point of view, it is also very interesting to have a compression scheme 
which has very fast performance, and which can exactly reconstruct the image when necessary. In 
addition, it is also very useful to have some wavelet transforms which exhibit the property of 
precision preservation (PPP), which can be utilized in the computer which has limited precision 
and limited memory without losing any precision during the computation. 

In this paper, we are going to describe two general methods from which one can get the 
integer wavelet transform desired. All of the wavelet transforms from the methods given in this 
paper possess the property of precision preservation (PPP). We draw on the work of several other 
authors who have already contributed to this area [2-3], where some specific examples were 
developed. However, this paper presents a more general method which allows one to see several 
new results as well as those presented and acknowledged prior to this work. 

This paper is organized as follows: Section 2 and 3 give some examples of integer wavelet 
transforms. The examples in section 2 arc the starting point for our approach, and the examples in 
Section 3 show the steps and motivation of our general method. Section 4 indicates how one can 
use the lifting technique to create an integer biorthogonal wavelet transform. The Correction 
technique to generate more general integer wavelet transforms is described in Section 5. Section 6 
describes bow to process boundaries in order to apply the integer calculation in finite sized images 
or signals. In Section 7, we prove the integer wavelet transforms developed by both the lifting and 
correction method possess the property of precision preservation (PPP). Some example images 
art also shown in this section. The last section. Section 8, provides the conclusion to this paper. 
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2. Basic integer wavelet transformations 

We provide the following two examples as the starting point for our new method. For the 
sake of convenience, length, and simplicity, we only discuss the algorithm for a one level 
decomposition and reconstruction and only for a one dimensional signal The extension to two 
dimensions is immediate as the rows and columns can be treated into a sequence of one 
dimensional signals. For the following examples, assume that {c?}^ is the original signal where 
the superscript indicaies level and the subscript indicates a particular point in the signal. Also, 
J^' and {dl are its decomposition pans at the fust level. Here 

, if ff is an eve n number, 
if N is an odd number ; 

{c[ and {dl}*^* are its low frequency (/) part and high frequency (A) part, respectively. For 
multi-levels, we just neat {cij^ 1 as {cj}^ and repeat the procedure again. 



gimmpi* i: A (2.2)-wavelet transform by integer calculation. 

This transformation is similar to a variation of the Haar wavelet transform which uses low 
and high pass analysis (decomposition ) filters given as: 



n 


0 


1 


k 


1/2 


1/2 


5. 


1/2 


-1/2 



(1) Compute 

(2) Compute 



(2-D 



AM* 



if N is an even number. 



(2.2) 



if N is an odd number. 
Here, Int(x) is an arbitrajy rounding function which may have different interpretations. 
For example, lnt(x) can be the integer which is nearest to x , or Int(x) may be any integer 
which satisfies x - 1 < Int(x) S x , etc. It is easy to see that all entries in both {ci J*^ and 
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From (ZIH22), we can easily get the following integer reconstruction algorithm: 

(b) Reconstruction 

( I) If N is id even number, compute 

4i a <i -Int(^-). k *0.-,Ar, - 1 ; (2 3) 

or, if N is an odd number, we have 



4.i = c i " WyO . * = 0,- • .. AT, - 2, 



(2) Compute 

4=<+cLw. *-0.-,A/,-1. 



(2.4) 



(2.5) 



fcnfirf Since ^^.^arenotJinwbecauseoftherounojngopcnUion Int(x).thi, 
means the transformation order becomes significant. For instance, if the decomposition 
was applied first to the columns and then to the rows, the inverse transfozroaiioo must be 
applied first to the rows and then to the columns. 



EaamgU 2: Lazy wavelet transform. 

The Lazy wavelet transform dot, not do anything. However, this illustrates an important 
concept. The corresponding inverse transform is nothing else but sub-sampling the even 
and odd indexed samples. Decomposition and reconstruction can use same formula as 
follows: 

Example* 1 and 2 are not good transforms for image compression, but they are simple 
Much better transforms can be achieved from these two. As suggested above, we consider them 
only as a sorting point for our integer, reversible, wavelet transform algorithm. 

We must mention that there is another interesting property in the above two transforms 
which may not be easily seen. If the values of the signal pixels are represented by a finite number 
of bits, say one bit or one byte, we can still use the same number of bits to represent the result of 
the forward transform within the computer itself because of the complementary code property. 
While, from the reconstruction algorithm, the computer will get back the exact original signal 
through the same complementary code property. We call this property a Property of Precision 
Preservation (PPP) for these wavelets. 
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It is known that the general values of the high frequency wavelet coefficients are small, and 
all higher levels in the decomposition also provide generally small values in the high frequency 
band. This allows the preservation of precision during the computational stage of the wavelet 
coefficients. Now, the complementary code property, the other aspect of the PPP property is a 
well known characteristic of integer arithmetic as done by the computer. Consider the computation 
of the difference of two integers given as c = b-a and the inverse computation of a ■ b • c. The 
nature of the computation within the computer can be specified as follows: 

\b-a (f -2*- , S6-fl<2«- , -l 

c„=<-2« + 6-o if b-oZ2 q " ] 
2' + b-a if b-a<-2*- { 



and the inverse is 

if -2"" 1 £fc-c m <2' -1 -1 
if b-c m *V~ x 
if b-c m <-7«- [ 

where the m subscript indicates the internal representation, and the range of the integers a, b, c is 
[-2 r \ 2 rl - 1]. The internal representation of c m when it is outside the range, its appearance is as 
a two's complement number, so the representation may not be the same as the external 
representation of c. However, the same complementary code For the a m will cause the internal 
representation to be identical to the external representation of a. For example, if we let £=2 
(00000010) and o=-/27 (10000001) then c m has the interna] binary value of (10000001) when 
q *4. With a value of • 127 for c m . the inverse value for a m will just be o. 

In fact, for Example 2, this property is obviously true. While for Example 1, if the range 
of the pixel values is within a finite number of bits, say q t we can only use q bits as the working 
unit, which means the value of transform coefficients will also be within the interval with length 
2 9 , say [-2 rl . 2**' - 1]. Due to the nature of computation on a machine, most machines will 
implement (2.1H2.2) automatically as follows (the complementary code property): 

(2.6) 
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Int(^-) + C».„ 



if •2 , "'SInt(i)+c J V,<2«"', 



**<y)+4.i-2\ if Tnt(i)+c^S2«-', 

mt(^-)+<4, + 2'. if i«(i)+ci 41 <-r J . 



(2.7) 



While the reconstruction algorithm (2.3) and (2.5) will be implemented by the computer itself as 



cJ-InK-^-), 
2«*^ci-lDt(i)j. 

|^c«-Uu(-^-)J-2«. if c'-Int(^-)>2^. 



if -2*^ Sc' l -Int(y)<2*. 
if c;-Int(^-)<-2 H . 



if -2'- , S</J + c£. 1 <2'- , . 



rf. l +c5 w +2«. if </i + c : ° u ,<-2^ t 



(2.8) 



(2-9) 



It is obvious that (2.8)-(2.9) arc just the reverse of (2.6M2.7). U is also easy to see chat if we 
properly take advantage of the bound in the coefficient size mentioned above, the algorithm can be 
implemented using a minima) amount of storage. 

3. More Examples and Additional Analysis 

In this section wc are going to give more examples which will give some motivation for our new 
approach. 

EumakJ; A (2,6)-wavelct transform by integer calculation [2]. 



This transfo rmation is similar to using following analysis filters 



n 


-2 


«1 


0 


1 


2 


3 




0 


0 


1/2 


1/2 


0 


0 


X. 


-1/16 


• 1/16 


1/2 


•1/2 


1/16 


1/16 



(a) Decomposition 

Decomposition start* with Example 1 at step (1) and (2), and then upgrades the high 
frequency component at step (3): 
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(1) Compute 

(2) Compute 



)+ , if N is an even number, 
. if is an odd number. 



(3) Compute 



.ci-c' 



4 = Im(^^-W» i*!,.,^-! 

I 4 



tnd then, if N is even, calculate 



else, calculate 



<-, = Int(^^.)-<,, 



(b) Reconstruction 

The reconstruction algorithm is identical to the decomposition algorithm, except it is now 
running "backwards". 
(1) Compute 

^ = Int4^)-4j 



4 



and then, if N is even, calculate 
else, calculate 

(2) If # is an even number, compute 



FLO 



c,° l4l =cj-lntfr). * = 0,^-l ; 
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or, if N is in odd number, we have 



19 



(3) Compute 



cJ»«*" + cLi. * = -.Af.-l. 



We see in step (2>(3) above, that they are just the same as shown for the reconstruction of 
the (2^)-waveltt transform (Example 1). 

riimplr < ; A (U)-wavelet transform by integer calculation. 

The following nonlinear transform is o variation of the transform which uses biorthogonal 
analysis filters: 



n 


•1 


0 J 


1 


K 


1 


0 


0 


i. 


1/4 


-1/2 


1/4 



(a) Decomposition 

TTus decomposition starts with the Lazy wavelet at step (1 ) and upgrades the high 
frequency component at step (2): 

c] *«0.-.M-l; 



(DSet 

(2) If AT is an even number, calculate 



d \ s 4«- *=0,--.M,-l. 



Otherwise, if N is an odd number, cakuJate 

(b) Reconstruction 

(2) If /V is an even number, calculate 
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Otherwise, if N is an odd number, calculate 

FTimnff %: A (5,3)-wavelet transform by integer calculation. 

This transformation is also similar in function to using the biorthogonaJ analysis filters. It 
is given by 



n 


-2 


.1 


0 


1 


2 




.1/8 


1/4 


3/4 


W 


•in 


i. 


1/4 


•1/2 


1/4 


0 


0 



(a) Decomposition 

This decomposition starts with Example 3 at step ( 1) and upgrade low frequency 
components at step (2): 

(1) Set c?*cl. Ab0.-.A^-1; 
If // is an even number, calculate 

Otherwise, if is an odd number, calculate 

(2) If N is an even number, compute 

4 

= c Nr2 - Int( ). 

Otherwise, if N is an odd number, calculate 
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«ci=ci'-I n t(^±^L). k = \,- .N,-2, 

4 

(b) Reconstruction 

(1) Compute 

c 0 °«e;+lnt(^.), 
Then, if is even. calculate 

eUe calculate cjj_, = 4 |H + lnt(— j--) . 

0 0 

(2) Compute c? wt = Int( C ^ Y 7W ) - ^ • * = 0. Af , - 2. 



Then, if is even, calculate cjL, = c°_ 2 - rf^ , . 

The PPP properry for Example 1-2 mentioned at the end of the previous section is also 
applicable for these three examples. It is obvious these three transformations are not really linear, 
but they arc similar to the one using the corresponding filters given above. Especially, the filters in 
Example 3 and Example 5 belong to, with minor modification, the group of the best biorthogonal 
filters for image compression according to both our experience and the conclusion of [4], 

Also, from the above three examples, we can note that if we begin with integer (linear or 
nonlinear) wavelet transformations and then use some proper upgrading formulas, we can get 
other, much better integer, wavelet transformations for image compression. Now, the key 
problem is: What kind of deductive formulas should be used? We provide an answer to this 
question in the following two sections, Section 4 and Section 5. 

4. Lifting Scheme and Integer Biorthogonal Filtering 

The Lifting scheme, discovered by Sweldens [I], is a new approach for constructing 
biorthogonal wavelets with compact support. However, the most interesting pan of this method 
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for us is: it can be used, with minor rnodificauon, to create integer biorthogonal wavelet 
transformations. The following is an adaptation of the technique of [1 J. 

Definition 1 . The set of filter* {A, h, g t g) is a set of biorthogonal filter* if the following formula 
is satisfied: 



where 



and K<0) = 2 V" md S fc*" - " • 

and similarly for m(a>). h{a>) and g(a>). 

The following lemma is the main result of the lifting scheme [1] reported as corollary 6 in 
(hat paper. 

limma 1. Take an initial set of finite biorthogonal filters {A, A 0 , g°. J ) , then a new set of 
finite biorthogonal filters {h. h, g t g) can be found as 

A(aO = AV)+*(a)*^ u) 

g(a))=g°(6))-MQ)W26)). 
Similarly, if we take {A 0 , h t g, g* J as an initial set of biorthogonal filters, a new set of finite 
biorthogonal filters [h, h, g t g) can be found as 

h«D) = A°(o>H jr(o>jf(23) j 

g(o))= g°fa)-h{a))J(2ca). 
Here, j(gj) is a trigonometric polynomial and the corresponding filter J is finite, and so is 7(G)). 
Actually, regarding the filters, (4.1) is equivalent to 

i 

- - Ti - (OW 

Next, we use the lifting scheme with minor modification to create an integer, nonlinear, 
quasi-bioitbogonal. wavelet algorithm. Suppose {cj} is a original signal, {c^Jand fy\}*xt 
again its low and high frequency decomposition pans, obtained by using the filters [h % h r g. g ) • 
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If we use filters [h , g) for decomposition (analysis), the corresponding decomposition algorithm 

m 



is 



While the reconsvuetion algorithm will be 



rl «, or, )• 



related to the synthesis filter {A, g\ , Here, parameters a and or, are positive constants with 
<z r *(Xg = 2. For example, in the situation of regular bionhogonal decomposition and 
reconstruction, a c = u 4 = V? ; and for Example 1 through Example 5 above, a, = 1 and or, = 2 . 

If the set of filters (A, A, g, g) is from {A. A 0 , g° t g) by (4.2b), then the decomposition 
can be accomplished as follows: 

m 



Calculate 



(4.3) 



2. Calculate 

The relative reconstruction scheme will be: 
] . Calculate 



* 

a. 



(4.4) 



(4.3) 



2. Calculate 



* 4*1 a, J 



(4.6) 



Here, equations (4.3) and (4.6) are just the wavelet ( inverse ) transforms using biorthogonal 
filters (A, A 0 , g c . g J . While (4.4) and (4.5) are forward and backward upgrading formulas. 

Similarly, if the set of filters {A, A , g t g] is from the initial set of filters (A 0 , A, j 0 } 
by using (4.2b), the relative decomposition is: 



1. 



Calculate 



4 =ff,Xcft-». 
• 
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2. Calculate d\ = d\° - ^c^s, . 

The reconstruction scheme is: 

1. Calculate d» = d[ ♦ 2l£ c « w J( 



2. Calculate 



For the sake of clariry, we haven't considered the boundary situation, but we will address this 
later. 

Corollary 4 1. Suppose biorthogonal filter* {A, A, g t g) are from initial filters {A, A 0 , g° % g ) by 
the lifting scheme (4.1a) or (4.2a). If the decomposition and reconstruction by filters 
{A, A °. g \ g J can be accomplished only by integer calculation, such as Example 2, wc also can 
create a corresponding integer wavelet decomposition and reconstruction scheme which is very 
"close" to the original one by using filters [h,h 9 g,g). Here the word "close" means that the 
difference of the two decomposition schemes is just some rounding error, and this rounding error 
will be corrected by the integer reconstruction scheme. 

In fact, if {c[ 0 } and }are integer after (4.3), we can calculate {cj } by 

c\ =c;°+Im 



(4.7) 



instead of (4.4). Here Intfx) , as described in Section 2, is an arbitrary rounding up function 
which satisfies x - 1 £ Int(x) £ x + 1 . It is obvious that (4.7) is very "close" to (4.4), and the exact 
reconstruction scheme can easily be obtained from 




(4.8) 



and (4.6). There will be a similar result, if the set of biorthogonal filters (A, A , g % g) is obtained 
from the initial set of filters {A 0 , A . g, g°) by using (4.2b). 

We can now note, except for the example shown in the Lazy wavelet, (Example 2) most 
standard biorthogonal wavelet transforms cannot be performed directly by integer, even for one of 
the simplest wavelets, the Hoar wavelet. However, if we properly choose the parameter* <x and 
or,, and slightly change the transform algorithms, such as Example 1 and Example 3, we can have 
a variation of the original biorthogonal wavelet transforms with respect to the set of filters 
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{A. A 0 , g) (or [h Q ,h 9 g t J 0 )). On the other hand, the parameters {j, } should be also 
chosen carefully to guarantee thai only addition and shift operations are needed by the algorithm. 

Another observation: if the set of filters {h 9 h t g, g) is obtained from a set of filters 
{h Q t h % g, g 0 } by the lifting scheme, and the set {A 0 , h . g, g°) is also obtained from a filter set 
(A 0 , h °, g °, | 0 } ♦ we can repeatedly use Corollary 1 to get a "close* integer wavelet 
transformation. 

5. The Correction Method for Creating Integer Wavelet Transforms 

In this section, we will describe another approach for obtaining integer wavelets by using 
the so called Correction method. The motivation of this method is from the S+P transform, and 
we will now generalize this approach. Actually, the lifting scheme for generating biorthogona) 
wavelets can be considered as a special case of the correction method. From this method we can 
get some even complicated filters with fast decomposition and reconstruction algorithm. 

Suppose that we already have a simple integer wavelet transform, such as Examples 1 
through 3, the decomposition and reconstruction scheme of which can be formulated as follows: 

Decompose A' = «.m) ' ' 

Reconstruction cl = //(ft °} (5.2) 

Here, (5.1) and (5.2) can be the same as (4.3) and (4.6) or other algorithms. 

In general, after the above decomposition, one may not be satisfied with the result. There 
may still be some correlation among the highpass components because of the aliasing from the 
lowpass components, or the lowpass components do not carry enough of the expected information 
from the original signal. Hence, we could make an improvement by putting some correction pan 
on the highpass components or lowpass components. There are many ways to accomplish this. 
However, for the sake of the integer calculation, we prefer to use following correction method. 
For example, if we want to make a correction for the highpass part, the corresponding formula 
would be: 

J] =</;-°-Ini(dci) k=--% 0, 1, 2.-. (5.3) 
Here, dc\ is a correction quantity for d\ 

<lc\ - icy^ + jT^. k - 0 , I . 2.- (5.4) 
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ajl j f {a.]^ and ^tj J^ 4 wr given parameters which have been chosen for the user's purpose, 

such as reducing the redundancy among highpass components or some other special requirement. 
We are not going to discuss how to choose these parameters, but one can refer to the references [3. 
5, 6] (or clarificaiioo ofthts pruccii. The only thiof we need to mention ii. for the Mfce of the 
integer calculation, any entries in both {a,. ]^ and {r ; £ ( should be rational numbers with 

denominators being powers of 2. 

From (5.1). (5.3) and (5.4) t it is easy to see the perfect reconstruction algorithm can be 

rfi^^+Int^Jks-, m. m-l.ra-2---. (3.5) 

combined with (5.2). 

As mentioned above, the Lifting scheme is a special condition of the Correction method. 
Examples 3 through 5 can also be considered as the examples of this method. We neat give an 
example of the Correction method which cannot be included in the group of Lifting scheme, and 
also which does not result in a closed form of compact support for bionhogonal filters. 



n 


-2 


-1 


0 


1 


2 


3 


h. 
t. 


0 

-1/16 


0 

-1/16 


1/2 
15/32 


in 

• 17/32 


0 

7/32 


0 

• 1/32 



While, the synthesis filters do not have compact support. However, the S+P transform can 
be implemented as follows: 
(a) Decomposition 

( 1 ) Take the decomposition step of Example I , that is, compute 



and 



1.0 



d =Int(^)+ck M *«<>.•••■*, -2, 
<f ,JD 

Int( m £ % ) + c,_, , if AT is an even number. 



if jV is an odd number. 
(2) Correction Step: Define s 0 - -1, S x = 1 . T » I and 

and now compute 
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In fact, the quantity b k would have the same value in both (4.7) and (4.8) if we calculate it 
in the same way. On the other hand if the working unit for b k is q bits, the machine will give b k 
another value, say b k ( - 2 f "' £ b k <2^ ). where b k is not equal to b k in the sense of 
mathematics if the value of f\ is beyond the interval [-2^\ 2 rl - 1J . However, b k will be the 
same in both (4.7) and (4.8). Therefore, the machine will automatically implement (7.1) and (7.2) 



and 







if 








if 








if 








if 








if 






cl -2'. 


if 





aim) 



(7.2m) 



It is easy to see that (7.2m) is just the backward operation of (7. 1 m). which provides the evidence 
tha the conclusion of this lemma is correct. 

It should be mentioned that the coefficients {cj } obtained by (4.3) and (7.1m) might not be 
the "real" wavelet coefficients using common sense. However, if we still use the working unit 
with q bits precision at the reconstruction step. (7.2m) and (4.6) will give the exact original signal 
back. On the other hand the coefficients {cj } still keep the most continuity of the "real" wavelet 
coefficients. Therefore, when we repeal the decomposition step on {cj }, most small coefficients 
in its high frequency part will be almost the same as the "real" coefficients (within some 
rounding error), which allows us to still take advantage of the "real" wavelet transform in image 
compression. 

A similar argument can show the same PPP property will hold for the integer wavelet 
transforms generated by the Correction method in Section 3. 

As we mentioned before* for many applications, the lossless image compression is as 
important as lossy compression. The integer wavelet transforms give the opportunity to compress 
without loss. It is also obvious that the integer wavelet algorithms can be used wherever ordinary 
wavelets are used, especially in signal and image compression. However, for most computers, the 
integer wavelet transform is much faster than the ordinary one and it uses much less memory. 
The following are some applications illustrating these types of transforms. 
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4 

> d\ = d? • Im( #-' * * "l c " " 2d " ) , 

Q 

(b) Reconstruction 

(1) Compute 

f e ' - 1 1 

^°-, = <^Im( ^- ? 4 C ^ ); 

, rf« = i .toC aci -»^- c '"- M " ) < 4 s W , - 2...J; 

(2) If is an even number, compute 

4 #l =cj-Int(^), -1 
or, if N is an odd number, we have 

cL,=cl-Int(^) ( * = <>,•■..*, -2, 

(3) Compute 

6. Boundary Conditions 

In the previous two sections, we did not show how to gel the integer, wavelet transform at 
the boundaries of signals. However, for all of the examples given above, the boundaries have 
been considered. There are two issues dealing with boundary filtering if we use the Lifting scheme 
or the Correction method to generate the integer wavelet transformations. The first is how to 
process the boundaries which occur in the start-up wavelet transformations. The second is how to 
deal with the boundaries in the deductive formula. If the boundaries in the start-up wavelet 
transform have already been established, then those in the upgrading formula are easy to establish. 
In fact, for the Lifting scheme, the boundaries in both steps should be processed in the same way. 
While, for the Correction method, it is easy to sec from (5.3M5.4) that one has more choices to 
process boundaries in the second step. Therefore, the only thing we need to discuss here is the 
process by which the boundaries in the start up wavelet transformations are established Assume 
we begin with compact supported biorthogonal wavelets. 
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Suppose the original signal is {f?}l 0 - For creating integer bionbogonal wavelet 

transformations we can use the following symmetric extension [7]: 

(1) . If cunmt biorthogonal filters have even length, we extend 
the boundaries of the signal as c! 4 = cf M9 k ■ 1,2.— ; 

(2) . If the filtcn have odd length, we do the extension as cf # = cf, k ■ I ,2; • • 
Example 1 through 5 use the boundaries give above. In Example 6, the start up wavelet 

transform uses the above boundaries, but in the upgrading step, another boundary filtering is used. 
In addition, for arbitrarily sized images or signals, one can use the same technique which we 
described in the above examples to deal with this condition. 

7. Some Applications 

Before talking about any applications of the integer wavelet transform given above, we first 
prove that a nice property of precision preservation (PPP), which is similar to the one mentioned in 
Section 2, holds for both the Lifting and Correction upgrading technique. This property is very 
important for many applications. 

I gmmi 7.1 Suppose that our integer wavelet transform starts with a pair of biorthogonal filters 
with the PPP property discussed in Section 2 ( that is, (4.3) and (4.6) possess this property. Then, 
the same property will be preserved in the whole algorithm if we adopt the Lifting scheme to be 
the upgrading formula. 

In other words. Lemma 7.1 states if we only use the working units with the same precision as the 
original signal or image to calculate the wavelet transform developed in Section 4, the equations 
(4.8) and (4.6) are still the backward operations of the equations (4.3) and (4.7). 

Assume that we only use q bits to represent images or signals, say, the range of the pixel 
values is within f— 2*^* . 2^' - 1] . According to the hypothesis of the lemma, the equations (4.3) 
and its inverse (4.6) have the PPP property. Therefore, what we have to verify here is that the 
equation (4.7) and its inverse (4.g) can preserve the same property. We rewrite (4.7) and (4.8) as 
follow: 

and its inverse 

c!° = c;-V (7.2) 

Here, 
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Application 1. Lossless image compression 

As mentioned at the beginning of this paper, the integer wavelet transformation 
established by the techniques described in this paper can always be used for lossless image 
compression because of the reversible ability. Especially, we can use the PP P property 
discussed in Lemma 7.1 . We have used this wavelet lossless technology (WLT) for gray 
scale lossless image compression, and we have tried several images. For most natural 
images, the size of wavelet lossless compressed images is much smaller than corresponding 
GIF images. Figure 1 through 4 give some examples. Figure 1 is a standard image for 
compression. Figure 2 and 4 are X-ray images and Figure 3 is a two-value image but we treat 
it as a I bit gray scale image in order to compare with the GIF format In fact, if we convert 
Figure 2 to a binary image, better result can be obtained by the JBIG technique. 




(312x312) 
Ffcorv I. Comprosion Rnio 
WLT: l.Vrl/GlF: 1.05:1 



(312x312) 
Fif yr» 2. Compression Rstie: 



WLT4.3:1/CIF: 2.72:1 



"Visioneer may have come up with on 
against the paper blizzard. . .gets pile; 
way to others throughout your compar 



Fijum 3. Compression Ratio: WLT: 20.8/ GIF 17.8 (132x794) 
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Figure 4. Compression Ratio: WLT3.8:1/GIF 1.98:1 (1232«I024) 

Application 2- Large scale medical image compression 

Usually, 12 bits are used to represent one pixel in medical images. In this situation, the 
values of the pixels vary from 0 ro 4095. Such images require careful treatment when a 
transform coding method is used for compression. If we use ordinary biorthogonal wavelets, 
the range of the transform coefficients will expand to [-2 16 , 2'*] when five levels of transform 
are used. Therefore, a longer working unit has to be employed, which consumes significant 
computer resources. However, the integer wavelet technique developed in this paper will solve 
this problem. For example, if we use the transforms given in Example 3, 5 and 6, the values 
of transform coefficient* will be limited to the range of [-2°, 2 U J. Even if we do not use the 
PPP property for these wavelets, 16 bits for the working unit is sufficient for all computations. 

8. Conclusion 

This paper has shown the processes necessary in order to obtain a non-linear, integer, 
biorthogonal, or non-biorthogonol reversible wavelet transform suitable for signal or image 
processing. We have shown how such a transform can be obtained either using the Lifting 
method, or the Correction method. For example, all interpolation wavelets can be modified to be 
corresponding integer wavelets without loosing any properties of original wavelets. In addition, 
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we have shown under certain conditions, the precision of the transform computation on the 
computer can remain at the same precision of the data, thus reducing the need for additional 
computer memory during the transform computation* These are e x tr em ely powerful techniques 
when the target data are large images, or the requirements establish a need for speed. 

Although this paper establishes the structure for the integer transform based upon the 
biorthogcmaJ wavelet or some non-bionhogonal wavelet, we do not imply the examples in this 
paper are necessarily the best wavelets for any particular application. However, we do claim if 
one is going to use such a technique, the ideas suggested in this paper will provide the best 
implementation. 

References 

1 . Wim Sweldens, The lifting scheme: A custom-design construction of biorthogonal wavelets. 
Applied and Computational Harmonic Analysis, Vol. 3 t No. 2, April 1996. 

2. A. Zandi, J. Allen, E. Schwartz and M. Bolieic CREW: Compression with reversible 
embedded wavelets, in IEEE Data Compression Conference, (Snowbird, Utah), pp.2 12*221, 
March 1995. 

3. Amir Said, An image muliiresolutlon representation for lossless and lossy compression, 
Submitted to the IEEE Transactions on Image Processing, 

4. J. Villasenor, B. Belzcr, and J. Liao, Wavelet filter evaluation for image compression, IEEE 
Trans. Image Processing, Vol. 4, pp.1053-1060. 

5. G.R. Kuduvalli and R.M. Rangayyan, Performance analysis of reversible image compression 
techniques for high-resolution digital tclcradiology, IEEE Trans. Med. Imaging, Vol. 1 1, pp. 
430-445, Sept. 1992. 

6. W.H. Press, B.P Flannery, S.A. Tcukolsky, and W.I Vettcrling, Numerical Recipes: the Art 
of Science Programming. Cambridge University Press, Cambridge, New York, 1986. 

7. G. Strang and Truong Nguyen, Wavelets end filter banks, Wellesley-Carabridgc Press, 1996. 



Chio-Fiihw 2) 



WO 98/40842 



92 



PCT/US98/04700 



i 



| N F I N I T R O N Compressor V3.0 

■ t i_w«^„«, «JtHV»™ Imite Comprtror (LS1Q version 3.0. ■ Window* 95 tool thit 
cooiprow «fll l ^J^7*;\ Veb , nd Graphic doigncu itat c.n b.ndl. > wide *.ri«, of d|«.ttl 

0 tra than J ^G. *™ =»» .u* jots 20 sccudt for intgo csHpnmd umUr JPEG. TnU *»> 

:SC5£X«!— --»■- _J* -* *..*«**.—.«*•■ 

less fronic ipwt* 




UlbtDiio Sirlli fcetsret 



Covprtsfio^ bailii w be compressed as high u 
200:1 utmg wivcieit-ecijnDlogy. 

Compress** CaatreL An EASY mode allow* the user 
w coc^ren intra with minimal input, requiring only a 
rir ^~* herween mow quality ox more cony essiw. Ad 
ADVANCED mod* enables lac user to select; I) image 
fila sis*. 2) compression rsoo, 3) PSNR. or 4) master 
level Wdb designers will like the one pep process to 
caarol the tixe of their image files, thus insuring tbe 
yptH an imige may be viewed oo a browser. 

Horn Uniform Comprrssiom. Region* of an image « n 
be selected for leu expression to preserve a hi tiff 
image quabiy while the rest of the image is oirnnressed 
10 the specified cormwuon rauo. In thia wiy important 
pons of a picture maintain cruciai detail* while (he over 
all picture file can be mads as small as possible 



PostRecoasiranioaFilten. Fihtra arc available to 
enhance the rccanstructed image. At cumrwe^iooumc 
tbgwer can press a control to have these Alien openwe 
•utonuiucallychrringrccuns^on. ^ efiUff *V l f ,UK 
quality intrwexaent. sharpen (edge txnancemeot). 
rnoothmg. and brighten. 

Trusparcudcs. The user will hove the ability «m 
pixels transparent so thai a color In the background 
Uirody on the page) can be seen through tbe picture. 
This is useful for creative web site developers. 

ItogrtssiveConmnssion. tota****"*^^ 
so that when it if viewed it will appear quickly an* 
low resolution, and then progressively up « 

detail as it in downloaded. TO* insures the viewer o°» 
not kne imcrcst while the Image is downloaded. 



WO 98/40842 



93 



PCT/US98/04700 



| N h I N I I \< U IN 



Compressor V3.0 




Cow* Lighmiofi Strike, 85:1 coaprasao 



Ibtat iifiimil. tic. 

Founded in WL INFINITRON. Inc. is i privatt 
corapeny ihfi sp«ci»lii« w the tojotudnaricaiuguf 
biro auiiiry imi^c ind video cwnorainn solutions for I 
wide array of**** 04 - INFINITRON u based is 
Vancouver. BC with tabs in Regina. Saskatchewan tad 
Demon Tcm*. 




Coir, JTEO W:l Canpreafeo 

H Pfi^tn— UrtBill glttB l«B» CWIWtfcll 

• images oo the Web 

• Pbao Stock 

• Dsa Warehousing 
« Catalogues 

• Video Games 

. COi (Encyclopedias. Museums, toence and Medicine) 

• Archives (An. History, Ccqgi logy) 

• Medical imagine 

Encode time typically less itsn 3 seconds fur a 320 * »0 
pueL 24 bit color image on s 133 MHz. Pentium with 16 MR 
RAM. 

■Iilnun Mtamaiiat* U8tt» 

Wmdowi 95/NT OS 

Pentium 100 MHz. 8 MB RAM 

2 MB fur program files 

10 MB plus to swap irmgc files 

iMttaVV lIHirTBM TMMSX* 

• Nawcane Navigator Flug-U> 

• Java Applet 

• ActiveX Control 

• Web Sits image Convener 

• Lightning Strike SDK 

• CiML Banner f.encmwr 




Download a FREE demo version of Lightning Strike Window* Cocnpr essor ton: 
wwwinf&uooxom 

INFlNTmON 3401 East University, #104. Denton, TX 76208 
USA Office Tel: 817.4*4.1165 FAX: 817.4gd.03IS 

INFINITRON lO*Flr 11 99 W. Hastings. Vancouver, BCV6B3T3 

Canada Office Tel: 604.688.9789 FAX: 604.688.9798 

KfeKfc 1 W Cnmnrtt INFTNTTRON R*^uh lnttm«ia«l. Inc. All Rlehu *c*t**6 



wo 



98/40842 



94 



PCT/US98/04700 



INFINITRON 




<t«l 



»r(LSI( 



wmaows image 
Compressor V3. 0 



Announcing, Lightning Strike Image CompreseorlLSIQ ver sion 3.0. a Windows 95 tool thai 
compresses srfll imago from 50:1 to 200:1 using Infinitron's proprietary Wavelet technology. LSIC is a 
versatile, easy to osa too* for Web and Graphic designers that can handle a wide variety of digital image 
formats and includes filters, and convenient web tools. Images can be compressed to files 4 times smaller 
than JPEG, while maintaining similar or better image fidelity. Images can be viewed in 2 to 5 seconds 
over the internet rather than 10 to 20 seconds for images compressed under JPEG. This has enormous 
benefits for reducing bottlenecks on corporate networks and the web, and in addition, requires less 
storage space. 




Ulltalnt Strike features 



Compression, imago can be compressed tcTiwr M*M 
ustng Wavelet Technology. 



Compression Control An EASY mode allows the user 
to uanpr&m images with minimal input, requiring only a 
decision between more quaiiiy or more compression. An 
ADVANCED mode enables the user to select; 1) image 
file size. 2) compression ratio. 3) PSNR. or 4) muter 
level. Web designers wiU like the one siep process to 
control the site of their image files, thus insuring the 
tpecd an image miry be viewed on a browser. 

Noo Uniform Compression. Regions of an image can 
be selected for Ira cornnrcwion to preserve a higher 
image Quality while the rev of the image ts compressed 
10 the specified cumpTwtun rami. Jn this way imprffiani 
pans of a picture maintain crucial details while the ova 
all picture file can be made as small as possible 



Pott Re coBunactioo Fillers. Filters are ovailable to 
cnbitoce trie reconstructed image At compression time 
the user con preset a control to have these filters operate 
euiemflucalry during reconstruaioa The filters include; 
quality improvement, sharpen (edge enhancement), 
smoothing, and brighten. 

Transparencies. The user will have the ability to set 
pixels transparent so that a color in the background 
(already on the page) can be seen through the picture. 
This is useful for creative web site developers. 

Progressiva Conspression. An image can be compressed 
so that when it is viewed it will appear quickly, first with 
low resolution, and then progressively building up in 
detail as u is downloaded. This insures the view© does 
nrn irxnc inter ea while the image ts downloaded. 



WO 98/40842 



95 



PCT/US98/04700 



INFiNITRON 



v.; 

i 

i 



| www jnnp. No Comprcwwo 




Ahutif tvnVmtON. Inc. 
Fouooca in 1992. INFTNTTRON, Inc. U a private 
cornr*ny inai so enables ra the design and rnaxxauig of 
lucb oualiry image and video compression solutions far a 
widsarravof markets. INnNTTRON is omimbJ in 
Vancouver. BC with labs to Region Saskatchewan and 
Denton Texas. 



windows image 
Compressor V3.0 




and Medicine) 



Lenna. JPE0 113:1 Compnaiaw 

ajnucatisas Ustminn &rffcs tuit ti 

• lro»g" on the Web 

• Photo Stock. 

• Data Warehousing 

• Cauioouca. 

• Video CiAmes 

• CDs (Encyclopedias, Muwrm, So 

• Archives (An. History. Otneolocy) 

• Medicil imapng 



Pirtarmiicc „ ftV , in 
Eatoce time typically ic*» than 3 -ccontH tor t 320 X»n 
piscl. 2* bit color image oc a 133 MH*. Pentium with 16 MB 
RAM 

HltlnuB lactBrasidst tvtlin 

Wimkiw* 95/NTOS 

Pentium 100 MHr. 8 MB RAM 

2 MB for program file* 

10 MB plus to twap image file* 



tottlinUHBTOOIl 

• Neucanc Navigator flug-ifl 

• Java Applet 

• ActiveX Control 

• Web Site image Convener 

• Lightning Strike SDK 

• OMT. Runner Cienmww 
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Compressor Version 3J) 

The Lightning Strike Compressor ii a Windows tool that compresses still imago from i wide 
variety of digital image formats using Infinitron's proprietary Wavelet algorithm. Images can 
be compressed to files 5 lima smaller than JPEG, while maintaining similar or better image 
fidelity. Images can be viewed in I nr 2 seconds over the internet rather than 10 to 20 
seconds for images compressed under JPEG. This has enormous benafio for transmitting 
over corporate networks or the web, and in addition, saves space required for storing all those 
images. 

Lightning Strike is a collection of tools in a user friendly environment Two levels of user 
control arc ofTered, one quick and easy for most applications, the othar a master I aval for the 
advanced user who wishes to control parameters to maximize image quality. 

The eompression approach used by Lightning Strike is based upon integer wavelets. This 
technology is acknowledged by leading expert* a* a superior compression technique as 
compared to discrete cosine transform used in JPEG. 



U^tnfrig'Stri Compressor f eatures 

Image Compression Options and Control 

Compression Technique Options 

Both Infinitron's Wavelet Compression and other frequently used compression methods are 
included in the product so users need only have Lightning Strike on their work station to 
pcriorrn all image compressions, images can be compressed to Wsveiet, JPEG, PNG, and 
GIF. 

Compression Quality Versus Speed Options 

The user can select one of two encoding processes that trade quality for speed of compression 
and ease of use, With the -Advanced- option selected, the optimum compression parameters 
are set by the user to give the best possible image* for selected compression ratio. With 
"Easy" selected you get the fastest compression without having to know details of parameter 
selection. 

Compression Ratio Control 

71* compressed image file size or compression ratio may be specified rather than the quality 
factor. This enables a web designer to control the size of their image files or the speed an 
image may be viewed, in a one step process. 

Region of Interest Focusing 

Regions of an image can be selected for leas compression to preserve a higher image quality 
while the rest of the image is compressed to the specified compression ratio. In this way 
important parts of a picture maintain crucial details while the over all picture file can be made 
as small as possible. This is also known as Non-Uniform Compression, 
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Split and Marge 

Very large imago, which could not otherwise be compressed due to their large size, can be 
ipltt into smaJlcr images and compressed individually. This process has the side advantage of 
using RAM more affectively speeding time for compression. The split images can be 
reassembled using the merge aspect or the feature. 

Post Reconstruction Filters 

Filters arc available to enhance the reconstructed image. At compression time the user can 
preset a control to have these filters operate automatically dunng reconstruction. The filters 
Include; quality improvement, sharpen (edge enhancement), smoothing, and brighten. 

Transparencies 

The user will have the ability to set pixels transparent so that a color in the background 
(already on the page) can be seen through the picture. This is useful for creative web site 
developers. This givo the ability to display pictures other than the rectangular shape allotted 
on the web page, i.c circles, polygons etc.. Also, designers often use this feature for 
shadowing, letters and objects. 

Progressive Decompression 

An image can be compressed so that when it is viewed it will appear quickly, first with low 
resolution, and then progressively building up in detail as it is downloaded. This insures the 
viewer docs not loose interest while the image is downloaded. 



WO 98/40842 



PCTAJS98/04700 



INFINITRON 

Lightning Strike 




Product Fact Sheet 

Windows Compressor 



lnrag» Comparisons 

Picture of Lena, with no Compression (512X512 Image) 
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Picture of Lena Compressed 100:1 with Lightning Strike 
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F(k : Fuoction» 
PNG File Structure 

The compressed images air uorzd in file format compliant with the PNC $ landed. In the 
future this file fontitt will replace the OIF formal used today. 



Batch Comprtss 

The user a able to compress many images at once by adding or deleting image file* (or paths) 
toe list box. 

Image Statistic* 

The compressor stores image statistics on each compressed image which may be viewed by 
the user. The following information is provided; image dimensions, compression ratio, file 
sizes, MSE, PSNR. maximum pixel difference, compression and decompression limes. 



Encoding and Decode Time. 

The typical time to encode or decode a 320X240, 24 bit color image is 1 second on a Pentium 
running ax 133 MHz with 16 Meg RAM. 

Minimum Recommended System 

The minimum system requirements for an IBM PC Compatible are: 

Hard Disc Drive 2 Mbytes free for program files. 10 Mb plus to swap 
image Tiles. 

Operaxing System MS Windows 3. 1 (Wm32y 93/ NT 
RAM 8 Mbytes 

This software is also available on the Apple MAC, Solaris, and UNIX platforms. 
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Ancillary infinitron Products 

NatscaDO Navigator Plug-in _ 
No«p« plo|-in» »w «v«ilib!e for the MacH k. Mac FPC. Widow, 3. 1 tnd 93/NT. 

Java Aoplet 

Java Applet, ait available for the Mac68k, Mac PPC. Widows 3.1 and 95/NT. 

^Ugh^ software in available for such applications as Microsoft ** 

\tmrrm Explorer, as an AcoveX control. 

Wtb Slta Image Convtrtor 

TV. utility will automate the conversion of web pages from JPEG to the Lightning Stnkc 
fannai The utility searches an HTML file ind replicates It replacing any JPEO imafietap 
wiih Lightning Strike tags and convening the JPEO image files to Lightning Strike. The 
vtdity can follow link ogi to recursively convert and replicate an enure web sue or sub- 
MOion of o web site to the Lightning Strike format Tnis uulily will be avulablc for 
Widows NT and most flavors of the UNIX operating lystem. 

Lightning Strike Software Developers Kit 

Using the SDK, a developer can integrate the highly efficient Lightning Stnkc module 
libranes into their own application!. 



Download a FREE demo version of Lightning Strike Windows 
Compressor from: www.infinttron.com 




Infinitron 5401 East University. #104, Denton, TX. 76208 

USA Office Tel: 817.484.1165 FAX: 817.484.0588 

Infinitron 10* Fir 11 99 W. Hastings, Vancouver, BC, V6E 3T5 

Canada Office Tel: 604.688.9789 FAX: 604.688.9789 
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Announcing, Lightning Strike™ Image Compressor (LSIQ version 3.0, a Windows 95 tool that 
compresses still images from 20:1 to 200:1 using INFINITRON's proprietary wavelet technology. LS1C 
is a versatile, easy to osc tool for Web and Graphic designers that cm handle a wide variety of digital 
image formats, and it includes filters and convenient web tools. Images can be compressed at ratios well 
in excess of present JPEG ratios while maintaining comparable image fidelity. This translates to much 
shorter image down load time on the web. This has enormous benefits for reducing bottlenecks on 
corporate networks and the web, and in addition, requires less storage space, 




UlltoiBO Strike Matures 



Compression. Uses a proprietary integer wavelet 

Compression Control. An EASY mode allows the user 
to compress images with minimal input, requiring only a 
decision uu w een quality and oomprcssion. An 
ADVANCED mode enables the user to select: 1) image 
file sue 2) compression ratio. 3) PSNR, or 4) miner 
level for professionals where every paramnrT can be 
altered. We also provide the highest wavelet lossless . 
compression for users wishing this capability. Web 
designers will like the one sup process to control the size 
of their image files allowing control over the delivery 
time of an image over a network. 

Non Uniform Compression. Regions can be selected for 
less compression to preserve image quality while the rest 
of the image is compressed to the specified compression 
ratio. In this way, important pans nf a picture maintain 
crucial details while the over all picture file can be made 



as small as possible 

Post Reconstruction Filters. Filters arc available to 
enhance the irorunruoed image. At compression time 
the user can preset a control to have these filters operate 

Hfl ftmati eally during TrrnnffntniotL The filters include; 

visual quality improvement sharpen (edge 
enhancement), smoothing, and brighten. 

Transparencies. The user will have the ability to set 
pixels transparent so that a color in the background 
(already on the page) can be seen through the picture. 
This is useful for creative web site developers. 

Progressive Compression. An image can be compressed 
so that when it is viewed it will appear quickly, first with 
low resolution, and then progressively building up in 
detail as it is downloaded. This insures the viewer does 
not lose interest while the image is dowitfoaded. 
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Founded in 1992, INFTKITRON, Inc. is a private 
company ihat rp*" aH *** in (be design and auriceting of 
high quality image and video comprTtnon solutions lor a 
wide amy of market*. IKFTKITROH is based in 
Vancouver. BC with offices in Regina, Saskatchewan and 
Denton Texas. 



Windows Image 
Compressor V3.0 




Cow. JPEO 85:1 C omprcaai o D 

tasflcatusa tar UottBttg **** toga CsBsruota 

• Images on the Web 

• Photo Stock 

• Data Warehousing 

• Catalogues 

• Video Games 

• CDs (Encyclopedias. Museums. Science and Medicine) 

• Archives (An. History, GeaeaJogy) 

• Medical Imaging 

Partarmiiea 

Encode uroe typically less than 2.3 seconds for a 640 X 4»u 
pixel 24 bit color image on a 133 MHz- Penuum with 16 M 
RAM. Decode ume ts less than .73. seconds. 

MIiIbbb ftacaoBiBdil 1 tyaua 

Windows 93/NT OS 

Pentium 100 MHz. 8 MB RAM 

2 MB for program files 

10 MB plus to swap image files 

AKOan tinimoi ftnti 

• Netscape Navigator Plug-in 

• Java Applet 

• ActiveX Control 

• Web Site Image Convener 

• Lightning Strike SDK 

• GML Banner Aninuuioxtf Compression 

• Black and White image Compression 




Download a FREE demo version of Lightning Strike Windows Compressor 
www.infiniuon.com 

rNHNTTKON 3401 Eas University. '104, Denton. TX 76208 
USA Office Tel: S17.484.U65 FAX: 817.484.0586 

NrTNTTRON 10*Flr 1 199 W. Hastings. Vancouver. BC.V6E3T3 
Canada Office Tel: 604.688.9789 FAX: 604.688.9798 
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What is claimed is : • 

1. A method for compressing an image, 
comprising the steps of: 

performing a wavelet transformation of the 

5 image; 

quantizing the wavelet transformed image; 
applying entropy coding to the quantized image; 

and 

outputting a file that includes the entropy 
10 coded image. 

2. The method of claim 1, further comprising 

the following step: 

performing a color transformation of the image. 

3. The method of claim 1, further comprising 

15 the following step: 

performing the wavelet transformation using an 

integer wavelet transform. 

4. The method of claim 3, further comprising: 
deriving the integer wavelet transform using a 

20 lifting scheme. 

5. The method of claim 3, further comprising: 
deriving the integer wavelet transform using a 

correction method. 

6. The method of claim 1, wherein the step of 
25 quantizing includes the sub-step of: 

processing the wavelet transformed image using sub-band 
oriented quantization. 

7. The method of claim 1, further comprising: 
comparing the wavelet transformed image to at 

30 least one predetermined threshold value. 
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8. A method for wavelet-based image compression 
using reduced color components, comprising the steps of: 

creating a color table for an input image having 
a plurality of pixels; 
5 calculating an index for each of the pixels, 

whereby generating a plurality of indices; 

performing a wavelet transformation on the 

indices; 

applying entropy coding on the transformed 
10 indices; and 

outputting a file that includes the entropy 
coded indices. 



9. The method of claim 8, further comprising: 
dithering the pixels to generate the indices. 

15 10. The method of claim 8, further comprising: 

partitioning a large image into a plurality of 
small images to produce the input image. 

11. The method of claim 10, wherein the large 
image is selectively partitioned. 

20 12. An image processing system, comprising: 

means for performing a wavelet transformation on 
an input image; 

means for quantizing the wavelet transformed 

image; 

25 means for entropy coding to the quantized image; 

and 

means for outputting the entropy coded image. 



13. The image processing system of claim 12, 
further comprising: 
30 means for receiving the entropy coded image; 

means for entropy decoding the received image; 
means for de-quantizing the decoded image; and 
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means for performing an inverse wavelet 
transformation on the de-quantized image to produce an 
output image. 

14. The image processing system of claim 12, 
5 further comprising: 

means for displaying the output image. 

15. The image processing system of claim 12, 
further comprising: 

means for transmitting the entropy encoded image 
10 over a communications medium. 

16. An image compression system, comprising: 

a compressor configured to generate a compressed 
image based on an integer wavelet transform derived using 
a technique selected from a lifting scheme and a 
15 correction method. 

17. The image compression system of claim 16, 
wherein the compressor quantizes a wavelet transformed 
image to produce the compressed image. 

18. The image compression system of claim 16, 
20 wherein the compressor entropy encodes a quantized image 

to produce the compressed image. 

19. The image compression system of claim 16, 
wherein the compressor performs a color transformation to 
produce the compressed image. 

25 20. An image decompression system, comprising: 

a decompressor configured to generate a 
decompressed image based on an integer inverse wavelet 
transform derived using a technique selected from a 
lifting scheme and a correction method. 
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21. A computer-readable memory storing a 
computer program for directing a computer system to 
perform image compression, wherein the computer program 
implements steps for performing a wavelet transformation 

5 of an input image, quantizing the wavelet transformed 
image, applying entropy coding to the quantized image, 
and outputting a file that includes the entropy coded 
image. 

22. A method of compressing a data file, 
10 comprising the steps of: 

performing a wavelet transformation of the data 
file to provide a series of wavelet coefficients; 

quantizing those wavelet coefficients which fall 
above a predetermined threshold value to provide a 
15 quantized series of wavelet coefficients; and 

compressing the quantized series of wavelet 
coefficients to provide a compressed data file. 

23. The method of claim 22 wherein the 
compressing step comprises the step of applying an 

20 entropy coding to the quantized series of wavelet 
coefficients. 

24. The method of claim 23 wherein the 
entropy coding is selected from the group of arithmetic, 
Huffman, run length and Huffman run length combined. 

25 25. The method of claim 23 further 

comprising the step of performing a color transformation 
of the data file prior to the wavelet transformation 
step. 



30 



26. The method of claim 25 wherein the 
quantizing step comprises sub-band orientation 
quantization. 
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27. The method of claim 26 wherein the 
wavelet transformation step comprises integer wavelet 
transformation. 

28. The method of claim 22 further 

5 comprising the step of filtering the data file prior to 
the wavelet transformation step. 

29. The method of claim 27 wherein the 
integer wavelet transformation comprises biorthogonal 
filter method. 

10 30. The method of claim 27 wherein the integer 

wavelet transformation comprises the correction method. 

31. A compressed data file comprising a wavelet 
transformation of a data file having a series of 
compressed, quantized wavelet coefficients, the quantized 

15 wavelet coefficients having a value above a predetermined 
threshold value to provide a quantized series of wavelet 
coefficients . 

32. A program for compressing a data file 
comprising : 

20 a routine for performing a wavelet 

transformation of the data file to provide a series of 

wavelet coefficients; 

a routine for quantizing those wavelet 

coefficients which fall above a predetermined threshold 
25 value to provide a quantized series of wavelet 

coefficients; and 

a routine for compressing the quantized series 

of wavelet coefficients to provide a compressed data 

file. 



WO 98/40842 



PCT/US98/04700 



1/6 
(begin) 





INPUT ORIGINAL IMAGE 






> 


f 






DISPLAY IMAGE 






\ 


f 




IMAGE TRANSFORMATIONS [ 


> 


f 


QUANTIZATION AND THRESHOLDING 




\ 


1 






ENCODING 






> 


1 




OUTPUT COMPRESSED IMAGE FILE 



20 



h 



24 



26 



28 



-30 




END 



Fig.l 



c° 


WAVELET 


c 1 


HD 1 


TRANSFORM 


VD 1 


DD 1 



Fig. 2 



WO 98/40842 



PCT/US98/04700 



2/6 



c 3 


HD 3 


HD 2 


HD 1 


VD 2 


DD 3 


VD 2 


DD 2 


VD 1 


DD 1 



Fig. 3 



c° 


INVERSE WAVELET 


c 1 


HD 1 


< 

TRANSFORM 


VD 1 


DD 1 



Fig. 4 



WO 98/40842 



PCI7US98/04700 



3/6 
(begin) 



60 



INPUT COMPRESSED IMAGE FILE |~ 




\ 


/ 






DECODING [- 








f 




DE-QUANTIZATION p 




i 


INVERSE IMAGE TRANSFORMATIONS \ 




t 






POST IMAGE PROCESSING 






i 







42 



44 



48 



DISPLAY DECOMPRESSED IMAGE 

— ~ 




50 



r END ) 



Fig. 5 





68 



70 



A 
V 



A 
V 



A 66 



CPU 




MAIN 




MEMORY 


<> 

62 


74-^" 



64 



I/O SUB-SYSTEM 



72 



Fig. 6 



a > 

Y 


1 t ^ 


. IMAGE STORAGE 


IMAGE SOURCE 




i 


^_ MASS STORAGE MEMORY 

76— S 1 ■ 1 



WO 98/40842 



PCT/US98/04700 



85- 



IMAGE 
SOURCE 



84- 



Fig. 7 



4/6 



COLOR 
CONVERTER 



COMPRESSOR 



91 




• I 
1 1 




DECOMPRESSOR 


<- 




89 

82 ^ 


88-^ 


-> 








y 






INVERSE COLOR 






IMAGE 
DISPLAY 


90— 




CONVERTER 




; > 



INPUT IMAGE 



COLOR TRANSFORM 



WAVELET TRANSFORM 



100 



102 



SUB-BAND ORIENTED QUANTIZATION 



SUB-BAND & QUANTIZATION 
RELATED ENTROPY CODING 



T 



OUTPUT COMPRESSED IMAGE FILE 



Fig. 8 



(^END^) 



104 



106 



108 



•110 



WO 98/40842 



PCT/US98/04700 



5/6 



(b^n) 



INPUT 
COMPRESSED 
IMAGE FILE 



-120 



ENTROPY 
DECODING 



-122 



DE-QUANTIZATION 



124 



INVERSE WAVELET 
TRANSFORM 



126 



INVERSE COLOR 
TRANSFORM 



if 



128 



130 



POST FILTERING 



DISPLAY 
DECOMPRESSED 
IMAGE FILE 



6 



132 




END 



Fig. 9 



( begin ) 



INPUT IMAGE 
WITH 
ORIGINAL COLOR 



-140 



CREATE 
COLOR TABLE 



-142 



-144 



CALCULATE AN INDEX 
FOR EVERY PIXEL 
IN THE IMAGE 



WAVELET 
TRANSFORM 



if 



146 



ENTROPY 
CODING 



\S 



148 



OUTPUT 
COMPRESSED 
IMAGE FILE 



.150 



(^ENtT) 



Fig. 10 



WO 98/40842 



PCT7US98/04700 




6/6 



•160 




ENTROPY 
DECODE 



-162 



173 

i. 



INTEGER COLOR 
TRANSFORM 



-172 



INVERSE WAVELET 
TRANSFORM 



\S 



-164 



QUANTIZATION ACCORDING 
TO USER'S REQUEST 



POST FILTERING 



I 



DISPLAY 
DECOMPRESSED 
IMAGE 



6 



166 
168 



INTEGER WAVELET 
TRANSF ORM 



174 



176 



ENTROPY CODING 



(END)Fig. 11 



OUTPUT COMPRESSED 
IMAGE FILE 



6 



178 




END 



INPUT COMPRESSED IMAGE FILE 



Fig. 12 



-180 



ENTROPY DE-CODING 



182 



INVERSE INTEGER WAVELET TRANSFORM \ — r 



184 



IN VERSE INTEGER COLOR TRANSFORM | r 

190 



186 



POST FILTERING 



•188 



DISPLAY DECOMPRESSED IMAGE ~| 



I 

END 




Fig. 13 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US98/04700 



A. CLASS. FI CATION OF SUBJECT MATTER 

IPC(6) :G06K 9/00 

US CL : Please See Extra Sheet. 
According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 382/232, 233, 236, 238, 239, 240, 244, 245, 246, 247 t 248, 249, 250, 251, 252, 253 



Doc u men ui ion searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data baac consulted during the international search (name of data base and, where practicable, search terms used) 



C. DOClfMKNTS CONSIDERED TO BE RELEVANT 



Category' 



Caution of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5,495,292 A (ZHANG et al) 27 February 1996, col. 3, lines 1- 
68. 

US 5,414,780 A (CARNAHAN) 09 May 1995, col. 4, lines 1-68. 



1-32 
1-32 



[ | Further documents arc listed in the continuation of Box C. Q See patent family annex. 



•E* 
•L* 

*0" 

•r 



Special categories of cited documents: 

document defacing the general stale of the art which is not coo* id trod 
to be of particular relevance 

earlier document published on or after the international filing date 

document which may throw doubts on priority cbuxn(i) or which is 
cited to establish the publication date of another citation or other 
tpcciaJ reason (as specified) 

document referring to an oral disclosure, use, exhibition or other 



document published prior to the international filing date but later t 
the priority dale claimed 



later document published after the international filing date or priority 
date and not in conflict with the application but cited to understand the 
principle or theory underlying the invention 

document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive step 
when the document is taken alone 

document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such combination 
being obvious to ■ person skilled m the art 

of the same patent family 



Date of the actual completion of the international search 



09 JUNE 1998 



Date of mailing of the international search report 

2 4 AUG 1398 



Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D-C. 20231 



Authorized officer 
LEO BOUDREAU 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCI7US98/04700 



A. CLASSIFICATION OF SUBJECT MATTER: 
USCL : 



382/232, 233, 236, 238, 239, 240, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253 



Form PCT/ISA/210 (extra sheet)(July 1992)* 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXfflBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



